-- Logs begin at Sun 2022-07-31 00:10:24 UTC, end at Sun 2022-07-31 01:43:04 UTC. -- Jul 31 01:03:41.590304 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 31 01:03:41.598834 dv-cinder-master-3-smb devstack@keystone.service[80444]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 01:03:41 2022] *** Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: nodename: dv-cinder-master-3-smb Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: machine: x86_64 Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: clock source: unix Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: pcre jit disabled Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: detected number of CPU cores: 4 Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: current working directory: / Jul 31 01:03:41.600866 dv-cinder-master-3-smb devstack@keystone.service[80444]: detected binary path: /usr/bin/uwsgi-core Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: your processes number limit is 47680 Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: your memory page size is 4096 bytes Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: detected max file descriptor number: 2048 Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: lock engine: pthread robust mutexes Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: thunder lock: enabled Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 31 01:03:41.601505 dv-cinder-master-3-smb devstack@keystone.service[80444]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 01:03:41.641516 dv-cinder-master-3-smb devstack@keystone.service[80444]: Python main interpreter initialized at 0x55e59c5619c0 Jul 31 01:03:41.641516 dv-cinder-master-3-smb devstack@keystone.service[80444]: python threads support enabled Jul 31 01:03:41.641516 dv-cinder-master-3-smb devstack@keystone.service[80444]: your server socket listen backlog is limited to 100 connections Jul 31 01:03:41.641516 dv-cinder-master-3-smb devstack@keystone.service[80444]: your mercy for graceful operations on workers is 90 seconds Jul 31 01:03:41.641852 dv-cinder-master-3-smb devstack@keystone.service[80444]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 01:03:41.641921 dv-cinder-master-3-smb devstack@keystone.service[80444]: *** Operational MODE: preforking *** Jul 31 01:03:41.642186 dv-cinder-master-3-smb devstack@keystone.service[80444]: *** uWSGI is running in multiple interpreter mode *** Jul 31 01:03:41.642186 dv-cinder-master-3-smb devstack@keystone.service[80444]: spawned uWSGI master process (pid: 80444) Jul 31 01:03:41.642379 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 31 01:03:41.643428 dv-cinder-master-3-smb devstack@keystone.service[80444]: spawned uWSGI worker 1 (pid: 80452, cores: 1) Jul 31 01:03:41.643428 dv-cinder-master-3-smb devstack@keystone.service[80444]: spawned uWSGI worker 2 (pid: 80453, cores: 1) Jul 31 01:03:41.643428 dv-cinder-master-3-smb devstack@keystone.service[80444]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 01:03:47.161428 dv-cinder-master-3-smb devstack@keystone.service[80453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:03:47.161428 dv-cinder-master-3-smb devstack@keystone.service[80453]: from cryptography.utils import int_from_bytes Jul 31 01:03:47.162225 dv-cinder-master-3-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:03:47.162225 dv-cinder-master-3-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 31 01:03:47.162638 dv-cinder-master-3-smb devstack@keystone.service[80453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:03:47.162638 dv-cinder-master-3-smb devstack@keystone.service[80453]: from cryptography.utils import int_from_bytes Jul 31 01:03:47.162745 dv-cinder-master-3-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 01:03:47.162745 dv-cinder-master-3-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 31 01:03:47.212715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:03:47.212900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:03:47.213086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] command line args: [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:03:47.213357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:03:47.213537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ================================================================================ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:03:47.213791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.214036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_dir = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.214223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.214405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_source = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.214488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 01:03:47.214588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] debug = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.214666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 01:03:47.214788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.215090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] command line args: [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 01:03:47.215160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 01:03:47.215280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.215363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ================================================================================ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 01:03:47.215431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.215668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.215752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] admin_token = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.215920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_dir = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] config_source = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_config_append = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] debug = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_dir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.216919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.217973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_config_append = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.218920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_dir = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.219851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.220042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.220207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.220320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.220557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.220804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] publish_errors = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.221881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] standard_threads = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.222926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_journal = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_json = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.223906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_stderr = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_syslog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] publish_errors = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.224686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.224906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.225009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.225094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.225255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.225338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.225493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.225569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.225729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] standard_threads = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.225812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.225962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.226039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.226201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.226347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.226471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.226553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.226631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_journal = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.226722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.226848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_json = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.226975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.227086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_stderr = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.227212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.227325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] use_syslog = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.227457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.227651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 01:03:47.227727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.227957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.228815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.229866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.230054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.230182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.230320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.230535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.231899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.232991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.233948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.234982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.235907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.236810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.237964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.238899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.239887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.240926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.241921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.242995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.243954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.244979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.245929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.246090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.246171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.246935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.247965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.248996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.249944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.250884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.external = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.251834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.password = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.token = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.252943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.253858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.254944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.255905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.256930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.external = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.257927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.password = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] auth.token = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.258943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.259878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.260958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.261787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.262892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.263877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.264941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.265824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.266964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.267913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.268972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.269929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.270868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271754 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.271832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.272958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.273980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.274935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.275884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.276997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.277867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.278945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.279988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.280969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.281900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.282856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.283863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.284854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.285969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.286991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.287868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.288931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.289852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.290837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.291979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.292947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.293033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.293728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.293857 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.293965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.294954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.295993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.296961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.297930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.298868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.299992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.300964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301760 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.301994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.302937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.303716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:03:47.303787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.304104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.304369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.304616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.304866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.305104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.305346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.305582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.305817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.306056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.306292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.306536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.306773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.307016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.307252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.307500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.307735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.307999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.308233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.308473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.308788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 01:03:47.309431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 01:03:47.333869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.334098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.334325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.334813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.335044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.335269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.342817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.343626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.373448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.373676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.374242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.374473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.426223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.426438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.476844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.477076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.478816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.479054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.542307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.542539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.542733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.542824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.542963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.543765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.544522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.566973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567335 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.567881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.568030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.568117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.568249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.568332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.568464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.579423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.579730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.593017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.593251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.593475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.593702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.593925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.594795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.595011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.595224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 31 01:03:47.611863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.612098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:03:47.612183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.612318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:03:47.612435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.612636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:03:47.612719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.612836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 31 01:03:47.612918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.613866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.623605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.623706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.623877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.623990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.624169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.624266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.624449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.624535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.631371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.631462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.636066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.636159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.636339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.636423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.636615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.636701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.636916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.637065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.637257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.637578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.637839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.637932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.638985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.639172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.639437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.662562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.662862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.664093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.664369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.664455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.664647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.669565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.669841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.669924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.670118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.670215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.670463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.676828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.677064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.677147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.677359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.681212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.681475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.681560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.681756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.681839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.682933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.683117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.683200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.683387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.699115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.699419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.699559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.700007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.703381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.703891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.706811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.707104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.707294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.707584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.711540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.712059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.714740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.715734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.718698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.718914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.718999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.719852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.720071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.720156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.720354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.736854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.736949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.737134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.737217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.737397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.737493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.737667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.737751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.744551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.744637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.746092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.746178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.746401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.746517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.749227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.749454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.749553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.749734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.749818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.750027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.750111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.750313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.750399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.750596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.761701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.762573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.762855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.762941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.763965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.764052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.764299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.764581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.780309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.780820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.783257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.783819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.786209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.786812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.788656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.789305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.790178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.790459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.790737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.790854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.791139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.791420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.797262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.798118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.798857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.799711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.801787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.802076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.802354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.802632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.802715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.802957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.803237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.803518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.810714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.810996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.811271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.811790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.812100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.812381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.818174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.818447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.818721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.818997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.819262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.819345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 31 01:03:47.819538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.819622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.819804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.819889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.820938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.821911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.822122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.822383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.822659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.822930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 31 01:03:47.856689 dv-cinder-master-3-smb devstack@keystone.service[80453]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e59c5619c0 pid: 80453 (default app) Jul 31 01:03:47.858031 dv-cinder-master-3-smb devstack@keystone.service[80452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e59c5619c0 pid: 80452 (default app) Jul 31 01:03:47.859966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119099-4585-4aa3-83a6-eaf4b5a04028 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:47.860259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119099-4585-4aa3-83a6-eaf4b5a04028 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:47.860533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119099-4585-4aa3-83a6-eaf4b5a04028 None None] PATH_INFO: `/v3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:47.864823 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Sun Jul 31 01:03:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:55.585316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.585841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.585933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.590856 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:03:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:55.596534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:55.596968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:55.597086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:55.667547 dv-cinder-master-3-smb devstack@keystone.service[80453]: INFO dbcounter [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] Registered counter for database keystone Jul 31 01:03:55.687497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG oslo_db.sqlalchemy.engines [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:03:55.693664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writer thread running {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:03:55.876775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG passlib.handlers.bcrypt [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80453) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 01:03:55.877188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG passlib.handlers.bcrypt [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80453) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 01:03:55.931805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:55.933420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:56.064316 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 31 01:03:56.199876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.269863 dv-cinder-master-3-smb devstack@keystone.service[80452]: INFO dbcounter [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] Registered counter for database keystone Jul 31 01:03:56.292946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG oslo_db.sqlalchemy.engines [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 01:03:56.299816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writer thread running {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 01:03:56.421379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d0b59-57e0-4618-b13a-9d94d3644089 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.425678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.426310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.426592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.426867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.435829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.488815 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 01:03:56.489109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd6f8e-3b8b-4856-b941-fe56518d92be admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.498916 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 31 01:03:56.504871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:56.519832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979622a7-d5f2-483c-a121-1d53aed113b1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:56.524336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:56.525456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:56.525742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:56.526018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] PATH_INFO: `/v3/projects/764484e0c3894629816e00d4d75ffb98` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:56.527488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] RBAC: Authorizing `identity:get_project(project_id=764484e0c3894629816e00d4d75ffb98)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:56.579842 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 31 01:03:56.580209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefa9ce-0f8a-45a4-b3f7-d9984c7ebcc3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:56.585309 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Sun Jul 31 01:03:56 2022] GET /identity/v3/projects/764484e0c3894629816e00d4d75ffb98 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:03:58.554125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36fdc-6aa6-42bd-97c0-4401a66c70d3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.554646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36fdc-6aa6-42bd-97c0-4401a66c70d3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.554742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef36fdc-6aa6-42bd-97c0-4401a66c70d3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.559079 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:03:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:03:58.564555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.564944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.565120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.585024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:03:58.586546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:03:58.595079 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 31 01:03:58.617207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36fdc-6aa6-42bd-97c0-4401a66c70d3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.630039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef36fdc-6aa6-42bd-97c0-4401a66c70d3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.634291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.634895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.635178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.635451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.643277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.645290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f9ec-10c5-4848-9bf6-f75e499cecf5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.654793 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:03:58.660091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:03:58.670057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309259ed-a153-4e8a-9c85-eef723daabb8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:03:58.674499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:03:58.675126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:03:58.675410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:03:58.675688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:03:58.677090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:03:58.678893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09d52e-841d-421e-90cb-6c34fcdbf7a6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:03:58.680462 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Sun Jul 31 01:03:58 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:00.752726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051965-279d-46d2-b539-a36c4db3089e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.753229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051965-279d-46d2-b539-a36c4db3089e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.753229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051965-279d-46d2-b539-a36c4db3089e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.754538 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:00.759749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.760170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.760343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.780789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:00.782000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:00.823280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dead-eaf0-4c5a-936a-e328d1d083a6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.823653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dead-eaf0-4c5a-936a-e328d1d083a6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.823956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3dead-eaf0-4c5a-936a-e328d1d083a6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.826098 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:00.831062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:00.831350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:00.831625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:00.863600 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:00.874130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 31 01:04:00.874566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 31 01:04:00.886480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:00.911385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:00.921180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:00.922785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:00.991090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7a2cb-2889-4cee-ac1a-4d8119de231a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.022641 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:01.024921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.025571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.025856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.026133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.038467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:01.045781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:01.048317 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:01.049232 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:01.050084 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:01.056582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.138133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.150168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e11de-f439-45f6-86f2-234aec486f5f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.152453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.156898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e316d1-4ff8-42ee-afb9-29a27afac8b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.190732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.190937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.191505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.191603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.191788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.191874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.192092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.192192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.192811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.193115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.194501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.206334 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:01.211884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.258257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.259776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.366240 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:04:01.372937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.376183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.425648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6f6f4-b01c-4e20-aaae-a895016881e9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.461810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.462456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.462737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.463009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.464229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.465735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.467268 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:01.472698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.476697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dd5cd-93f1-46ce-871c-f4cd225a7c5d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.487282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.513849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.514709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.514992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.515268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.533248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.534701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:01.552248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:01.553055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:01.554098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:01.554098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:01.554098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:01.554098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:01.554098 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:01.560123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.576763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43aef-4b32-4a41-ae34-17d412ce3502 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.610435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.611092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.611385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.611668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.612883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.614334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.615917 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:01.617137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.622467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:01.663352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0c126-e7fc-4c91-8251-6825fe227bce None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.696086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.696705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.696985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.697254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.697938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.698237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.700266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99526cf-1d6d-4594-88f4-f32fb0771e26 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.703451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:01.717918 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:01.724007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588b69-5797-40a3-87e1-55f1e1707391 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:01.762103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:01.762787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:01.763172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:01.763457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:01.764322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.domain.id=default, user.id=4871a0537f4545959c95c90b68cc52fd) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:01.764642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:01.766160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d4fb1-b006-4689-9918-014197e24cd8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:01.773956 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Sun Jul 31 01:04:01 2022] GET /identity/v3/role_assignments?user.id=4871a0537f4545959c95c90b68cc52fd&scope.domain.id=default&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:04.223541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81268-e7ca-4ca7-b689-cc0b48832457 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.224593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81268-e7ca-4ca7-b689-cc0b48832457 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.225102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81268-e7ca-4ca7-b689-cc0b48832457 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.226902 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:04.245643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d23e3-0b01-412d-bd99-99a426756f7c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.246131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d23e3-0b01-412d-bd99-99a426756f7c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.246408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d23e3-0b01-412d-bd99-99a426756f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.254496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534e0f-d933-406a-87b6-efad55704867 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.255108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534e0f-d933-406a-87b6-efad55704867 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.255606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534e0f-d933-406a-87b6-efad55704867 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.258372 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 12/23] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:04.268261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.268856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.269333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.271639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a29d23e3-0b01-412d-bd99-99a426756f7c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:04.272896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a29d23e3-0b01-412d-bd99-99a426756f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:04.305423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:04.306640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:04.393237 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:04.394567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d1ab-97d8-4d00-95f2-57541a90cec8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.394806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d1ab-97d8-4d00-95f2-57541a90cec8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.395084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42d1ab-97d8-4d00-95f2-57541a90cec8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.396666 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 13/25] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:04.403821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.404184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.404410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.434104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:04.436083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:04.479829 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 13/26] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 31 01:04:04.481554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.535914 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:04.536922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.552386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:04.617092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:04.648260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dfd0f-56e2-4738-8464-d9c4f1a51164 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:04.690491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:04.691148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.691432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.691712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.711154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:04.712665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:04:04.743908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:04.744740 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:04.745523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:04:04.745523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:04:04.745523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:04:04.745523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:04.749520 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 15/28] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:04.750350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.755057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebe894-5929-467a-9907-bdbbfb46f4f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:04.824013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:04.824702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.824984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.825316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.849671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:04.857036 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:04.857889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:04.858619 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 14/29] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:04.859239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:04.860527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:04.906002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52276f35-6b8d-4289-a2c9-5dcec20e77e1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:04.941994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:04.942628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:04.942911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:04.943185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:04.944052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:04.945663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b2be-b09a-44c9-956c-8bb08aafb707 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:04.983772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428b1aa-5e3a-49f9-be7e-e2335dbadd01 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.084019 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 16/30] 10.222.0.47 () {60 vars in 1131 bytes} [Sun Jul 31 01:04:04 2022] POST /identity/v3/roles => generated 219 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:05.084799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33379adb-5b09-434a-b7c7-3ba39a7bc421 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.085099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33379adb-5b09-434a-b7c7-3ba39a7bc421 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.085386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33379adb-5b09-434a-b7c7-3ba39a7bc421 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.086869 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 17/31] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:05.087563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33379adb-5b09-434a-b7c7-3ba39a7bc421 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.125379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.186379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.187022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.187307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.187582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.188316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:05.188627 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.190023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bf9d0-9b62-42ec-9c33-2423b27d44d2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.210196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33379adb-5b09-434a-b7c7-3ba39a7bc421 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.211715 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 15/32] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.218063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.218352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.218635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.232005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.253710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.254344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.254615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.254883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.255613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:05.255916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.257469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.269250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:05.270494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:05.271912 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 18/33] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.272978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.365958 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 16/34] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:05.366793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.476107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269014-eafe-4b6a-8164-3f47f25782a8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.507554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.513643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a383a-d9d8-4b5f-995f-7a62d90b84f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.523246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.523881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.524233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.524511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.525202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.526655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff12a9-af07-49a9-8c3e-d2d8bdf1dc31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.551065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.551811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.552127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.552408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.554074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.555615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.557306 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 17/35] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.558041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.567968 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 19/36] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/projects => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:05.567968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26c6-fd47-4fcf-ac77-2f72aa7ee003 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.567968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26c6-fd47-4fcf-ac77-2f72aa7ee003 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.567968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26c6-fd47-4fcf-ac77-2f72aa7ee003 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.568367 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 20/37] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:05.571993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df26c6-fd47-4fcf-ac77-2f72aa7ee003 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.609396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.688321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8a520-8862-4535-94e7-b80732656252 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.691782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df26c6-fd47-4fcf-ac77-2f72aa7ee003 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.727919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.728601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.729851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.729851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.730024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:05.730312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.730409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.730644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.731448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.732256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:05.732388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24c00-b861-4bba-90a6-d8fc3ba80ec1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.733569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa4a5b-aac9-430c-b499-da1dee25aab4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:05.734077 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 21/38] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:05.735232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bebfc-885b-49fb-9a82-34b9af8b2fc5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.735518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bebfc-885b-49fb-9a82-34b9af8b2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.735795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bebfc-885b-49fb-9a82-34b9af8b2fc5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.738641 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 22/39] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:05.739155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.739439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.739717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.761551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:05.763230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:05.832526 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 23/40] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:05.833345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:05.861883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.862195 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 18/41] 10.222.0.47 () {60 vars in 1131 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:05.863641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:05.864000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:05.864259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:05.884368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:05.886004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:05.908406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:05.956817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1d8a-4d49-4d06-ae3e-6928af223e41 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:05.979958 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 19/42] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:05.979958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.000433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.001168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.001453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.001736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] PATH_INFO: `/v3/domains/default/users/4871a0537f4545959c95c90b68cc52fd/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.004761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4871a0537f4545959c95c90b68cc52fd, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.006365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.022542 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 24/43] 10.222.0.47 () {58 vars in 1361 bytes} [Sun Jul 31 01:04:05 2022] PUT /identity/v3/domains/default/users/4871a0537f4545959c95c90b68cc52fd/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:06.023624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.121185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80f8d2-2b7a-4c81-a63f-d67c37b73798 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.160471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.161128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.161412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.161690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.162908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.163359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.164563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.166416 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 20/44] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:06.172804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:06.186436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1dbb0-e2ab-4cc2-8626-6959bb135310 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.209691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:06.236824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.237551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.237841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.238127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.238856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.240314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e9d02-5a73-4add-929d-c94adef392ad None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.259741 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 25/45] 10.222.0.47 () {60 vars in 1131 bytes} [Sun Jul 31 01:04:06 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:06.338683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bbd1e-be9d-4ca4-aed3-d727e9f1cf22 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:06.393507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:06.395054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:06.395054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:06.395054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:06.395964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:06.398017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc8ec7-dffc-4e47-a970-f95a1788d97f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:06.436687 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 21/46] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:04:06 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:08.098622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4fd36-43f2-4311-b8cd-33d575b92380 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.099130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4fd36-43f2-4311-b8cd-33d575b92380 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.099275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4fd36-43f2-4311-b8cd-33d575b92380 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.100693 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 26/47] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:08.106695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.107205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.107294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.125160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:08.126359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:08.192576 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 22/48] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:08.215780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4fd36-43f2-4311-b8cd-33d575b92380 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.318630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4fd36-43f2-4311-b8cd-33d575b92380 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.352566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.353142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.353429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.353708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.365832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:08.370783 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:08.372119 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:08.372961 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 27/49] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:08.379560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.382752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.484435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7e181-187e-43a1-93f6-adb5a3d2aaf8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.518132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.518764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.519057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.519341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.520097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:08.520410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.521806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f3510-9133-4ddf-a545-c309d7da63f6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.534123 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 23/50] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:08.539662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.541855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7088ac-3397-49b4-9d3c-19e1dae69d0c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.542156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7088ac-3397-49b4-9d3c-19e1dae69d0c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.542445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7088ac-3397-49b4-9d3c-19e1dae69d0c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.544463 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 24/51] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:08.549552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e975-3a74-4411-b050-b71c55143995 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.549851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e975-3a74-4411-b050-b71c55143995 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.550136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e975-3a74-4411-b050-b71c55143995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.551616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.569401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0511e975-3a74-4411-b050-b71c55143995 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:08.570646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0511e975-3a74-4411-b050-b71c55143995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:08.631173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.638633 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 25/52] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:08.646449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34417f-3297-4023-bdf6-01ef27109369 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.661087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511e975-3a74-4411-b050-b71c55143995 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.680336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.681044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.681338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.681617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.683177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.685380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.686978 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 28/53] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:08.692339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.761797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511e975-3a74-4411-b050-b71c55143995 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.767200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.791006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5f0a7-b5ed-431a-9935-3a9c0fd08a05 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.795237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.795904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.796217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.796491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.797632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.799071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.800682 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 26/54] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:08.806169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.825735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.826380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.826672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.826953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.828159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.829601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.831187 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 29/55] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:08.837012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:08.867455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:08.904882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bea15-2a52-4edd-b3ff-9c1195d4de1b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.938362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a17f-32ec-4960-9bb3-ec9b6588ddc5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:08.938620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.939239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.939522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.939798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.940513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.941960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b11f1-ae64-4302-b0ab-608040b9ef8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.968501 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 27/56] 10.222.0.47 () {60 vars in 1140 bytes} [Sun Jul 31 01:04:08 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:04:08.973786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:08.974428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:08.974720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:08.975000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:08.975816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.domain.id=default, user.id=4871a0537f4545959c95c90b68cc52fd) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:08.976167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:08.977690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df49da2-6834-4b82-98c2-da089dc5b13a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:08.985247 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 30/57] 10.222.0.47 () {56 vars in 1322 bytes} [Sun Jul 31 01:04:08 2022] GET /identity/v3/role_assignments?user.id=4871a0537f4545959c95c90b68cc52fd&scope.domain.id=default&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:10.983810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb99d5-6a89-43ef-9788-5a4bfa5feaf4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.984361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb99d5-6a89-43ef-9788-5a4bfa5feaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.984442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb99d5-6a89-43ef-9788-5a4bfa5feaf4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:10.985746 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:10.990752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:10.991110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:10.991324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.009549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:11.010749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:11.013784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.082553 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:11.106956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb99d5-6a89-43ef-9788-5a4bfa5feaf4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:11.206126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb99d5-6a89-43ef-9788-5a4bfa5feaf4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:11.221654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.240100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:11.240687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:11.240977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:11.241257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.242430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:11.243884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8dfdf-82b6-4810-9ae8-4143fcb7beb1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:11.245491 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:11.251342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:11.347781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807d88e-a0ff-49a2-9723-1637c355bcd8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:11.380711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:11.381318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:11.381602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:11.381879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:11.382563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:11.384028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e4b56-567f-4008-b859-801595470ef8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:11.398414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:11.412445 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:11 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:14.611723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f987-8b74-4480-ba8b-d1d4a4070281 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.612292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f987-8b74-4480-ba8b-d1d4a4070281 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.612292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4f987-8b74-4480-ba8b-d1d4a4070281 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.613665 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:14.619674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb61d2-32f6-4f42-9268-42301cf6eacf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.620098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb61d2-32f6-4f42-9268-42301cf6eacf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.620299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb61d2-32f6-4f42-9268-42301cf6eacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.649250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-11fb61d2-32f6-4f42-9268-42301cf6eacf None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:14.650469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-11fb61d2-32f6-4f42-9268-42301cf6eacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:14.748645 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:14.750496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e97a3-08b0-4bed-a788-cf29a1702e0b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.750790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e97a3-08b0-4bed-a788-cf29a1702e0b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.751074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e97a3-08b0-4bed-a788-cf29a1702e0b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.752449 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 31/64] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:14.764873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c9d9-f491-445c-bcb6-d560905f2c49 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.765171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c9d9-f491-445c-bcb6-d560905f2c49 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.765457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c9d9-f491-445c-bcb6-d560905f2c49 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.767107 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 34/65] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:14.772161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9dae-4cb1-4757-b814-8a1c3c7dcf13 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.772455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9dae-4cb1-4757-b814-8a1c3c7dcf13 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.772739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e9dae-4cb1-4757-b814-8a1c3c7dcf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.779658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c9d9-f491-445c-bcb6-d560905f2c49 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:14.795162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e91e9dae-4cb1-4757-b814-8a1c3c7dcf13 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:14.796749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e91e9dae-4cb1-4757-b814-8a1c3c7dcf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:14.871013 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:14.873126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.873638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.874142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.889462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5c9d9-f491-445c-bcb6-d560905f2c49 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:14.893325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:14.894768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:14.915555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:14.929232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:14.930195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:14.930617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:14.931028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:14.942298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:14.947664 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:14.948588 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:14.949311 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:14.951683 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 35/67] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:14.952705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:14.986385 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 33/68] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:14.987562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.054463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.084605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20796eff-04ad-495a-bbf5-77cee506b020 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.112494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6777e-f95f-468f-a8f3-a774123148a7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.124244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.124894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.125180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.125458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.136941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:15.143085 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:15.143914 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:15.144684 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 36/69] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:15.145296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.153238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.153939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.154227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.154506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.155224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:15.155537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.156979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aa744-a812-4125-a26c-a57b35540331 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.170443 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 34/70] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.170443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a570c-f9b7-43d2-878c-b50232492956 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.170443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a570c-f9b7-43d2-878c-b50232492956 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.170443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a570c-f9b7-43d2-878c-b50232492956 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.170443 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 35/71] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:15.171459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a570c-f9b7-43d2-878c-b50232492956 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.200834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.260247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2b038-2df2-4812-a3aa-5860303af076 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.275948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a570c-f9b7-43d2-878c-b50232492956 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.282898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.294713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.295372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.295665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.295983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.306030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:15.310977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.311598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.311885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:15.312016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:15.312848 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:15.313599 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:15.314183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.314183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:15.314311 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 37/72] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:15.314380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.314444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.314564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92264be4-acea-43ca-8eab-577e4630c147 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.322907 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.324241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28547c6-893d-4fec-a4f9-5cbb9b5456a4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.324576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28547c6-893d-4fec-a4f9-5cbb9b5456a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.324855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28547c6-893d-4fec-a4f9-5cbb9b5456a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.342669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f28547c6-893d-4fec-a4f9-5cbb9b5456a4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:15.343867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f28547c6-893d-4fec-a4f9-5cbb9b5456a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:15.408740 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 37/74] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:15.410201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2419-b2b6-4ee7-89bf-b205281a0239 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.410496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2419-b2b6-4ee7-89bf-b205281a0239 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.410780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc2419-b2b6-4ee7-89bf-b205281a0239 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.412055 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 38/75] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:15.412767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2419-b2b6-4ee7-89bf-b205281a0239 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.430767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186331-fc6a-4dce-9d60-43b593612116 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.433298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.472732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.473379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.473665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.473951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.487674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.489496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.491129 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 38/76] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.491900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.530305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.535196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc2419-b2b6-4ee7-89bf-b205281a0239 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.570188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.570809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.571096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.571373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.572123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:15.572434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.573801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88181b-182b-40f7-bd76-db58ce9c6559 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.586896 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 39/77] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.586896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.586896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.586896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.591774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9028c7-9111-4b45-9ce0-1b8011cc8baa None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.603514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:15.604737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:15.627190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.627834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.628143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.628421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.629591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.631203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.632832 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 39/78] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.633585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.671237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.674055 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 40/79] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:15.682025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.741631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506ea0-ee95-4e1f-8e59-a3e3f7698bff None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.774075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.777162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.778426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.778764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.779048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.785305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccb95d-1cd7-4dac-91c8-257127f4a4e4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.789203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:15.794730 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:15.795558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:15.796378 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 40/80] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:15.796981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.822071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.822615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.822895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.823171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.885884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.889801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.891282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.895370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5fe9e-acac-4362-814e-e032c58e96a4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:15.929532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:15.930229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:15.930515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:15.930798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:15.931984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:15.933436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:15.935744 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 41/81] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:15.936373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:15.979417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:15.990935 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 41/82] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:15.991781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.036543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ff5c-e585-4250-80c9-76278df659df None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.070069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.070689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.070981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.071262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.092804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbed0f-8981-4676-a63c-fa112de0bf91 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.099538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.126892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.127535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.127823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.128136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.129731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.131188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.132823 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 42/83] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.133592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.142667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.144193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.191297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.233169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dda4d0-5993-4719-9004-bdebea4730c6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.245275 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 42/84] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:16.246119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.271858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.272509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.272792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.273067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.273808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:16.274117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.275483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.283463 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 43/85] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.284272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.303427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.345052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a4b4-08cb-4092-972c-309cd1180c2b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.378418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.379034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.379321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.379601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.386537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f154f8-f56a-48fe-bac4-b490f1fd42cd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.406115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.420617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.421253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.421538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.421823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.422983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.424447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.426104 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 44/86] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.426846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.451897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.453429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.510986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.530565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66d28b-0420-4734-9de3-4d712a021c23 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.553285 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 43/87] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:16.554126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.565315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.566339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.566650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.566925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.567998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.569458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.597707 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 45/88] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:16 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:16.598717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.666366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.680992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3750c-31bd-4621-8446-58b804f0a1bd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.724286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.725042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.725321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.725603 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.726944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.728583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.731338 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 44/89] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.737643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.740271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd74c6-4bf7-48e4-a3d1-3b8cbb13e19d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.772283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.788365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.789033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.789321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.789612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.790885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.792387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.794429 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 46/90] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.795231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.880026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415c30d-83bb-4db1-a2ef-9399fd7ee97a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.924550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc8d7b-52e5-4bd6-ae92-575461fb5692 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:16.929587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.930657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.931184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.931657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.932731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:16.932855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.934506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.941532 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 45/91] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.941532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:16.942383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:16.985462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:16.986251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:16.986612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:16.986976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:16.989315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:16.992305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:16.995843 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 47/92] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:16.997544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.103671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.129976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d9945-7ddf-41c3-a5c0-19ae09dc9e80 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.158105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b5c2-0548-47cb-bc42-2e9704c12c60 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.175270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.176444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.176930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.177495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.178528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:17.179038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.180955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.188559 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 46/93] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:17.189684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.208746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.209761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.210243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.210737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.321476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.362073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.364890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.378146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9164fc2-0776-46b5-80c8-b68d26dd108c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.455534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.456210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.456501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.456785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.457913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=4871a0537f4545959c95c90b68cc52fd) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:17.458235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.460141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.472554 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 47/94] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:17 2022] GET /identity/v3/role_assignments?user.id=4871a0537f4545959c95c90b68cc52fd&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:17.525711 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 48/95] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:17.537541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.572645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.702901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4f94b-08e7-4a4f-aaab-68f0ca4a2a8b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.744968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.745640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.745936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.746219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] PATH_INFO: `/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.750550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] RBAC: Authorizing `identity:get_project(project_id=5dd1aefd04254007a855a00c4fd6fcf8)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.752133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf432f7-8a04-4ce1-a3fe-ff7e6bfb2cae None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.754245 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 48/96] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:17 2022] GET /identity/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:17.760079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:17.863966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:17.891146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f934-2559-42ba-ba3a-050ab7462fdc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:17.936898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:17.937897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:17.938385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:17.938860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:17.939867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=5dd1aefd04254007a855a00c4fd6fcf8, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:17.940427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:17.942098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363bb04-d65b-4fed-ade8-e675b53e4ba8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:17.955666 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 49/97] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:17 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=5dd1aefd04254007a855a00c4fd6fcf8&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:19.032044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14031-b6dd-409a-825e-d723369a10a5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.032579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14031-b6dd-409a-825e-d723369a10a5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.032579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b14031-b6dd-409a-825e-d723369a10a5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.033952 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 49/98] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:19.039275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.040116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.040606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.061266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:19.062761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:19.151976 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 50/99] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:19.187072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14031-b6dd-409a-825e-d723369a10a5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.294498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:19.315130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b14031-b6dd-409a-825e-d723369a10a5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:19.356627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:19.357279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.357571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.357853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.372438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:19.377853 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:19.378660 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:19.379402 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 50/100] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:19.386238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.501798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:19.534351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb86b24-2389-4632-a1e3-cf4e6c0a87eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:19.579031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:19.579669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.579974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.580262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.580995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:19.581309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:19.582963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:19.592003 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 51/101] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:19.597703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.736605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a11290-bf89-40e3-82db-e95bd9032631 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:19.779949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:19.780604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.780892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.781179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] PATH_INFO: `/v3/users/44caf237a06f44aaabae00d9bb71dd06` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.807274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] RBAC: Authorizing `identity:get_user(user_id=44caf237a06f44aaabae00d9bb71dd06)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:19.808804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c286-0f9f-4a07-acce-22a769f919e5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:19.811434 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 51/102] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:19 2022] GET /identity/v3/users/44caf237a06f44aaabae00d9bb71dd06 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:19.817074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:19.914613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb649-0ad7-4f5e-8528-daf562313426 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.914896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb649-0ad7-4f5e-8528-daf562313426 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.915114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fb649-0ad7-4f5e-8528-daf562313426 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.916739 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 52/103] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:19.921550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:19.921841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:19.922130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:19.929709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:19.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:19.953830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:19.964585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bba03-126b-465a-9480-3309fa4954b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.003732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.004415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.004705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.004991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.019284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:20.097201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:20.098706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:20.113284 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 53/104] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:20.149441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:20.203323 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 52/105] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:20.210446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:20.295897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:20.368935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbaf4c-d5e3-4d02-bca4-6fdf17adfa4e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.424848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a0009-cc74-4693-b645-3b34f1e9a420 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.444030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.445052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.445334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.445621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.456323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:20.467494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:20.473367 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:20.474382 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:20.475281 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:20.477762 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:20.485410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:20.492632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.493301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.493588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.493896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.495070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:20.496844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:20.499086 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 53/107] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:20.505481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:20.647048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335b1d1-4dfe-4336-a923-c18fca1d7a29 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.648104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcce265-71e0-49b0-9edd-f3aba9bd8a94 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.651824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:20.687360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.688014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.688350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.688572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.689582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=44caf237a06f44aaabae00d9bb71dd06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:20.689723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:20.691161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97a7e-f67c-486b-8899-3cb053286f8f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:20.695690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.696521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.696975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.697398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.698273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:20.698730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:20.701360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb0c3-4bc1-417b-8fe1-3e95bed3407b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:20.704572 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 54/108] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/role_assignments?user.id=44caf237a06f44aaabae00d9bb71dd06&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=5abf87471833492b8acb0f2b8699c656 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:20.705768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7326-b90f-4fa9-a26b-703fed2bdf2c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.706071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7326-b90f-4fa9-a26b-703fed2bdf2c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.706408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7326-b90f-4fa9-a26b-703fed2bdf2c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.708366 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 55/109] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:20.709471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318dd6c-6501-4e5b-9963-604080aa9c79 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.709759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318dd6c-6501-4e5b-9963-604080aa9c79 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.710036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318dd6c-6501-4e5b-9963-604080aa9c79 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.712916 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 55/110] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:20.716505 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 56/111] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:20.718393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8acceb-7d91-486f-97d6-2ce7433eba50 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.719609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318dd6c-6501-4e5b-9963-604080aa9c79 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:20.720280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8acceb-7d91-486f-97d6-2ce7433eba50 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.720993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8acceb-7d91-486f-97d6-2ce7433eba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.764361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4f8acceb-7d91-486f-97d6-2ce7433eba50 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:20.767361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4f8acceb-7d91-486f-97d6-2ce7433eba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:20.867622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:20.893090 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 56/112] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:20.894637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f285-77f1-4881-8c54-715fb7411ffc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.895157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f285-77f1-4881-8c54-715fb7411ffc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.895635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161f285-77f1-4881-8c54-715fb7411ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.923512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9161f285-77f1-4881-8c54-715fb7411ffc None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:20.924795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9161f285-77f1-4881-8c54-715fb7411ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:20.930133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318dd6c-6501-4e5b-9963-604080aa9c79 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:20.971830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:20.972441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.972733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.973014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.974655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:20.976542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932c32f-0e81-4ae8-a0bc-71be6fb18238 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:20.978707 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 57/113] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:20.979978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182f9f-bc51-4f5c-a306-841e823eb5a4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:20.979978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182f9f-bc51-4f5c-a306-841e823eb5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:20.980294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2182f9f-bc51-4f5c-a306-841e823eb5a4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:20.985398 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 58/114] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:20.985398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2182f9f-bc51-4f5c-a306-841e823eb5a4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.010206 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 57/115] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:21.011445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1be0-ea7c-4a19-bc85-da99db808dc8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.011845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1be0-ea7c-4a19-bc85-da99db808dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.012820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f1be0-ea7c-4a19-bc85-da99db808dc8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.014331 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 58/116] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:21.016747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f1be0-ea7c-4a19-bc85-da99db808dc8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.034428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.107460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2182f9f-bc51-4f5c-a306-841e823eb5a4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.131629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f1be0-ea7c-4a19-bc85-da99db808dc8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.142334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.142996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.143284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.143563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.151988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.156033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-188227bd-3377-4f3a-9148-35665deb4b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:21.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:21.162611 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:21.163459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 59/117] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:21.164887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.165179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.165462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.178845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.179479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.179763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.180058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.181222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.182684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74c21e-b059-4071-8ce4-77aa2e6d6d31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.184175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:21.185011 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 59/118] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:21.185397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:21.190275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.190568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.190849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.211195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:21.212430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:21.268317 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 60/119] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:21.268317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.289003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.294523 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 60/120] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:21.295387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.376078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79c6ae-952c-4cc6-b488-be1b03d0d3f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.402288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62418935-a2fa-4a6b-bbdd-cf995d55afb8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.411848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.412637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.412931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.413226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.414385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.415866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.417716 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 61/121] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:21.418969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.423725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.451502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.452173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.452560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.452736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.453479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:21.453781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.455164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.468806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 61/122] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:21.468806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.534099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.542326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376d280-17b6-494f-8ff2-bf49cf4b7db7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.576517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ccb94-802c-4207-9eb4-50415fa7ff4f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.580351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.581070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.581315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.581590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/2a3537f72d114efcba7870b8e99dc9c7/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.583996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user_id=2a3537f72d114efcba7870b8e99dc9c7, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.585581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.602603 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 62/123] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:21 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/2a3537f72d114efcba7870b8e99dc9c7/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:21.603676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.622351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.623474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.624002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.624501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.638087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:21.644727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:21.645715 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:21.646597 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:21.654445 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 62/124] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:21.655776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.698454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.732727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87021a37-f8ac-49ff-ac51-e039155e09d4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.788386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.789219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.790455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.791316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.798347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5579e-391d-48f1-a42a-a6b5a45a4964 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.806703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:21.813501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:21.814518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:21.815402 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:21.817424 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 63/125] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:21.818335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.836437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.837112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:21.838065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.838501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.838935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.839827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.841779 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.877232 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 63/126] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:04:21 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:21.878452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.938947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29ebd-fc57-4eb1-b10d-714a47f87715 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:21.978850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:21.979312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:21.979602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:21.979883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:21.981837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:21.983516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:21.985275 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 64/127] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:21.986043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:21.996152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.010717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a6949-2fb5-4c17-b326-8755f714dfec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.053500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.054079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.054372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.054649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.055495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:22.055807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.057395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.068233 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 64/128] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.069564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.088343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.123751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe359b-ae9d-41bd-8fbe-ad4245b7c231 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.192475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ec221-1501-4aed-a10d-ec1fdf4c7741 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.200085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.200722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.201005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.201287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.202005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:22.202313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.203690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.212693 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 65/129] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.218165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.235725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.237309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.238102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.238601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.240685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.242373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.245556 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 65/130] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:22 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.247949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.274774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.339988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb3438-50f4-4ee5-82f7-33bef8e5270d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.385164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.385926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.386437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.386540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.387959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.391330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.393125 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 66/131] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:22 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.394934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b7a9-ee2f-42da-acce-f6c07dcec5fd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.398335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.429833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.438462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.439573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.440086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.440536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.447962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.450284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.453659 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 66/132] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:22 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.454305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.606401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.614280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b9d4a-0cbc-4336-a3bd-93884e249381 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.623962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f1a54-d596-4bd0-b340-00ad8aac0ce1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.660345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.661054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.661345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.661627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.662799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.664499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.666157 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 67/133] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:22 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.666914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.692865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.693566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.693853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.694138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/2a3537f72d114efcba7870b8e99dc9c7/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.701465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user_id=2a3537f72d114efcba7870b8e99dc9c7, role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.702950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.735589 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 67/134] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:22 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/2a3537f72d114efcba7870b8e99dc9c7/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:22.737016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.782200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974030b9-cfee-45b5-8ca7-3da7b47ab45c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.823003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.823827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.824189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.824524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] PATH_INFO: `/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:22.825993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] RBAC: Authorizing `identity:get_project(project_id=5dd1aefd04254007a855a00c4fd6fcf8)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:22.829826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:22.829826 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 68/135] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:22 2022] GET /identity/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:22.836031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:22.865910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.888064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:22.951635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ddfdd-7324-41c5-8b01-ac4776b69979 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.960050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb034e-22bd-4bd3-9391-67e8312ac143 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:22.997526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:22.998341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:22.998624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:22.998900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] PATH_INFO: `/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8/users/2a3537f72d114efcba7870b8e99dc9c7/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.001123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] RBAC: Authorizing `identity:create_grant(project_id=5dd1aefd04254007a855a00c4fd6fcf8, user_id=2a3537f72d114efcba7870b8e99dc9c7, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:23.002704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d3e8-d523-421e-ae24-81db60fa6f0f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:23.020157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:23.020924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.021210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.021489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/4871a0537f4545959c95c90b68cc52fd/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.023870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user_id=4871a0537f4545959c95c90b68cc52fd, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:23.024723 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 69/136] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:22 2022] PUT /identity/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8/users/2a3537f72d114efcba7870b8e99dc9c7/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:23.028293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf01d7-2c8e-498b-a0ed-0b933f59ed85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:23.065592 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 68/137] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:22 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/4871a0537f4545959c95c90b68cc52fd/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:23.172233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206894d-0663-4722-81cc-13242044b03e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.172847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206894d-0663-4722-81cc-13242044b03e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.173359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206894d-0663-4722-81cc-13242044b03e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.175028 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 70/138] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:23.190413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.190925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.190998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.217360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:23.218586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:23.310273 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 69/139] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:23.333357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206894d-0663-4722-81cc-13242044b03e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:23.430681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:23.454932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206894d-0663-4722-81cc-13242044b03e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:23.507245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:23.507901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.508257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.508535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.521247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:23.526298 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:23.527145 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:23.528024 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 71/140] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:23.533829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:23.608538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:23.658238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61b854-bccd-4687-8a35-56131f9a9056 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:23.701645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:23.702204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.702493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.702779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.703509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:23.703820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:23.705239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:23.720749 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 70/141] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:23.726536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:23.853011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6331989-c46d-4023-8f6c-58ca3ce6c953 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:23.902201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:23.903299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:23.903774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:23.904278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] PATH_INFO: `/v3/users/44caf237a06f44aaabae00d9bb71dd06` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:23.908609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] RBAC: Authorizing `identity:get_user(user_id=44caf237a06f44aaabae00d9bb71dd06)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:23.910312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:23.912137 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 72/142] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:23 2022] GET /identity/v3/users/44caf237a06f44aaabae00d9bb71dd06 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:23.917735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.063539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360532a5-b270-408e-aabf-69337a22f477 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.088881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.101304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.101961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.102250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.102531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.103716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.105202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0f15b-2aaa-4de5-9426-b959a57a4f9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.107839 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 71/143] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:23 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:24.113605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.126737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.229862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6951629-e613-4a0a-bb2f-0e45d92ae422 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.230353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6951629-e613-4a0a-bb2f-0e45d92ae422 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.230423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6951629-e613-4a0a-bb2f-0e45d92ae422 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.232726 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 72/144] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:24.240713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65df53-8f72-48ef-b92c-3847798bcc34 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.243725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.244045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.244331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.271467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:24.272696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:24.316167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.316827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.317116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.317392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/44caf237a06f44aaabae00d9bb71dd06/roles/5abf87471833492b8acb0f2b8699c656` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.320847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user_id=44caf237a06f44aaabae00d9bb71dd06, role_id=5abf87471833492b8acb0f2b8699c656)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.322829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.349121 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 73/145] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:24 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/users/44caf237a06f44aaabae00d9bb71dd06/roles/5abf87471833492b8acb0f2b8699c656 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:24.394362 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 73/146] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:24.436891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.530592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.565684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10460-99fc-4434-9efe-6646adb43d28 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.605079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.606677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.607179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.607554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.619551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:24.625910 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:24.626779 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:24.627512 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 74/147] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:24.632835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.745848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b0e4-a492-4581-b5be-e7f41edb77e1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.771476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.787836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.788514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.788802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.789138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.789875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:24.790182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.791576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.803409 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 74/148] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:24.809639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:24.916418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd394-e122-425e-8f9e-d3d0f4a6769f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:24.947197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:24.954138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:24.954790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:24.955077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:24.955349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:24.960647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:24.962131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d382470-f016-42b6-861a-e45e1b00198a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:24.963787 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 75/149] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:24.969911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.101655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404bf4e-49fe-4e25-b2b1-ec0041f5bee8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.145184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.145807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.146088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.146359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.203833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf62a8-ad4f-4e69-8576-6601f332b90f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.204139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf62a8-ad4f-4e69-8576-6601f332b90f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.204335 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf62a8-ad4f-4e69-8576-6601f332b90f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.205715 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 76/150] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:25.212366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:25.225411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.225690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.225969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.229744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.231871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.266009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:25.267240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:25.392089 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 75/151] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:25.393227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.402291 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 77/152] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:25.443043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.514543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:25.532098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39372a4e-7c8a-4ee4-9114-b8cbc160657d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.568436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.569430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.569889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.570310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.571642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.573405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.575290 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 76/153] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:25 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:25.583149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.646771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b0774-01c8-4976-9a95-e4e2c261a4ad None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.692476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:25.711334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.711334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.711334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.711334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.711768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.711904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.713553 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 78/154] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:25.720031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:25.731553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15da2-d824-4eb6-baef-ceccc156017d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.779416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.780499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.780986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.781485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.782584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:25.783173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.784853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c07a8f-464e-4a14-8176-5d33a3d6b778 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.791595 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 77/155] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:25 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:25.845212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7934a9-35c0-4821-abb6-21568be8f9aa None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:25.896791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:25.897436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:25.897721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:25.897999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:25.898717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:25.900254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d522d5bd-74ab-4916-a08c-061d92a3bcfc None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:25.936415 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 79/156] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:25 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:26.111324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c4a6-8a51-4988-a508-11ba9eef0b25 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.111621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c4a6-8a51-4988-a508-11ba9eef0b25 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.111902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c4a6-8a51-4988-a508-11ba9eef0b25 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.113289 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 78/157] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:26.119067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c359-86f3-4d2b-9be8-8b87f383eb59 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.119703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c359-86f3-4d2b-9be8-8b87f383eb59 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.120280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93c359-86f3-4d2b-9be8-8b87f383eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.148465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ad93c359-86f3-4d2b-9be8-8b87f383eb59 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:26.150056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ad93c359-86f3-4d2b-9be8-8b87f383eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:26.224150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.249115 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 80/158] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:26.257700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ac1a-534e-4a0c-bc1c-126ab69aadcf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.258154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ac1a-534e-4a0c-bc1c-126ab69aadcf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.258261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ac1a-534e-4a0c-bc1c-126ab69aadcf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.259830 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 79/159] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:26.266362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.266653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.266967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.282918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ac1a-534e-4a0c-bc1c-126ab69aadcf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.290561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:26.292539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:26.310755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.386365 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 81/160] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:26.412153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.436877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ac1a-534e-4a0c-bc1c-126ab69aadcf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:26.482037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:26.483017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.483601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.483881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.497662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:26.504247 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:26.505221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:26.506020 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 80/161] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:26.513959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.532594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862210fd-d674-4308-8057-a9fbe60a5d03 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:26.546841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.570590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:26.571299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.571584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.571856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.584188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:26.589500 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:26.592174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:26.594124 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 82/162] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:26.599971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.613575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.650097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3803-199c-4071-9e8f-56e6054583aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:26.707585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:26.708511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.708804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.709061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.709780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:26.710083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:26.712687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b77e9-473a-4027-a35b-e430a5381be0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:26.723134 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 81/163] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:26.724419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9d3b4-ef89-40b8-90a1-2be711dfa5a9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.724704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9d3b4-ef89-40b8-90a1-2be711dfa5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.724981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9d3b4-ef89-40b8-90a1-2be711dfa5a9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.726193 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 82/164] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:26.732392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.732679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.732963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.748855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11349d8-ebc6-495e-9a9c-44d4dabda4c4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:26.754566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:26.755786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:26.791167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:26.792135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.792664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.792955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:26.794663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:26.795256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:26.797397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:26.810154 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 83/165] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:26.811069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.851228 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 83/166] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:26.852129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:26.861039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.953855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff41ea-f2ff-4f18-a6dc-499c84f72dce None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:26.954298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:26.997050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:26.997954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:26.998552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:26.998854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.000414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:27.001525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca69a-5953-487a-ab26-f8949b879d44 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:27.001893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:27.003729 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 84/167] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:27.004738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.048186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:27.048885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.049166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.049435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] PATH_INFO: `/v3/users/2a3537f72d114efcba7870b8e99dc9c7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.050755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] RBAC: Authorizing `identity:get_user(user_id=2a3537f72d114efcba7870b8e99dc9c7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:27.052229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:27.053945 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 84/168] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:26 2022] GET /identity/v3/users/2a3537f72d114efcba7870b8e99dc9c7 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:27.060597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.140708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf7196-f6de-4608-9f51-44781ddd6fd8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:27.142956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.186015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f55f-396f-47cb-b7a7-0134aad32544 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:27.187511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:27.188214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.188594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.188874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.201701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:27.208276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:27.210399 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 85/169] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:27.212361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.230114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:27.231290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.231630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.231888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.239262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.330577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:27.333140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:27.333902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ace09-8ccb-4f4a-a2b8-fcd32d3166dc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:27.387965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:27.387965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:27.388261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:27.388472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:27.431965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.477589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:27.478983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:27.672215 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 86/170] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:27.673080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.795408 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 85/171] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:27.796307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:27.827691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.937185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:27.967849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa709-a894-4c20-934b-ae6ad47cc3ef None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.010355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903fc00-4e2a-40cc-abe9-463e5116f219 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.046997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.047581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.047850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.048157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] PATH_INFO: `/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.049365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] RBAC: Authorizing `identity:get_project(project_id=5dd1aefd04254007a855a00c4fd6fcf8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.050813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.052936 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 86/172] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/projects/5dd1aefd04254007a855a00c4fd6fcf8 => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.053736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.065510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.066251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.066565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.071964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.071964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:28.071964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.071964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa01630-09ec-44d6-8fcf-f038b2b760db None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.093630 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 87/173] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.095495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c71f-4171-4916-8099-643127254342 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.096038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c71f-4171-4916-8099-643127254342 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.096532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0c71f-4171-4916-8099-643127254342 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.098250 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 88/174] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:28.099163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c71f-4171-4916-8099-643127254342 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.160042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34755b6-c60e-4d9b-a7c1-575e5d58718c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.164286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.195879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.197165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.197445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.197718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.198905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.200925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.202590 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 87/175] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.208368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.310281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c068a-ae61-48e8-836f-61790eea20eb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.328175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0c71f-4171-4916-8099-643127254342 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.344854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.345495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.345774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.346048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] PATH_INFO: `/v3/users/4871a0537f4545959c95c90b68cc52fd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.347229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] RBAC: Authorizing `identity:get_user(user_id=4871a0537f4545959c95c90b68cc52fd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.348750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0974e1-5494-4f03-9d7c-ddf100686224 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.350353 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 88/176] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/users/4871a0537f4545959c95c90b68cc52fd => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.351686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.351995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.352272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.366140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.379225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:28.380456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:28.399100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.399731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.400033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.400307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.401095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=5dd1aefd04254007a855a00c4fd6fcf8, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:28.401432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.403521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.416657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.421098 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 89/177] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=5dd1aefd04254007a855a00c4fd6fcf8&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.421912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.454266 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 89/178] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:28.455266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.571033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d082690-30f7-4dce-b5d2-70684245df34 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.611275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.612019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.612315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.612815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.635100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fc035-c3ea-4de9-8414-90f25bcc8eb7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.657353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.690188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.691926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.713903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.714525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.714803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.715207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.716160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=2a3537f72d114efcba7870b8e99dc9c7) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:28.716469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.717910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.725029 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 90/179] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/role_assignments?user.id=2a3537f72d114efcba7870b8e99dc9c7&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:28.725951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.805642 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 90/180] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:28.812248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:28.841897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.888380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:28.920241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03bdea-05b3-4151-bea8-46deea9b136d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.937722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa9bdf-989f-4a9a-869a-a815367da48c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:28.958285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:28.958942 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:28.959217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:28.959491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:28.960766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:28.962224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:28.969618 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 91/181] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:28.971006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.006972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.007733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.008037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.008313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.033400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:29.039347 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:29.041750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:29.044231 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 91/182] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:29.052048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.086700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1bea21-af40-41e0-bf59-641a328c3216 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:29.126361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.126910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.127187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.127457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.128283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=4871a0537f4545959c95c90b68cc52fd) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:29.128592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:29.130297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:29.144072 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 92/183] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:28 2022] GET /identity/v3/role_assignments?user.id=4871a0537f4545959c95c90b68cc52fd&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:29.232629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d90b43-7c46-44ce-916e-62c33a3cd59d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:29.252799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:29.282812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.283442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.283728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.284028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.284775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:29.285068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:29.286469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:29.295420 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 92/184] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:29.301231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.304285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:29.438396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdda73-4fe4-443a-8141-fc1593dec86f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:29.480734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.481780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.482278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.482758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] PATH_INFO: `/v3/users/44caf237a06f44aaabae00d9bb71dd06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.484280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] RBAC: Authorizing `identity:get_user(user_id=44caf237a06f44aaabae00d9bb71dd06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:29.486014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b834379-3d08-4fa9-8b0e-56f569f09a49 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:29.487881 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 93/185] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/users/44caf237a06f44aaabae00d9bb71dd06 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:29.496256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.500761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375d0e-2295-4126-b11a-789f4347bac1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.501053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375d0e-2295-4126-b11a-789f4347bac1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.501338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22375d0e-2295-4126-b11a-789f4347bac1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.502676 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 94/186] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:29.508426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.508897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.509324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.539355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:29.540839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:29.632024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:29.641398 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 95/187] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:29.650203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c280c-6533-4327-bed0-392300c3d928 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:29.669896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.695328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.696858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.697636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.698134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.755459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:29.784916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:29.786283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775f334-8326-4b95-99c8-680f499180d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:29.787054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f018ff-b15b-4f0b-ab4f-a9567f11ea55 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:29.828685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:29.829690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.830278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.830789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.843691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:29.849458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:29.850312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:29.851101 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:29.853896 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 96/188] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:29.861083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.920212 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 93/189] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:29.921602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f1f1-6251-4f3d-b5f0-fceae123d94a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:29.921900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f1f1-6251-4f3d-b5f0-fceae123d94a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:29.922181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0f1f1-6251-4f3d-b5f0-fceae123d94a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:29.924066 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 94/190] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:29.925935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f1f1-6251-4f3d-b5f0-fceae123d94a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:29.931499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:29.978383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424753-1141-49db-b593-ba3f7cc3aaae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.008062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.017303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.017931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.018212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.018485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.019205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:30.019516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.020926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20f884-2eaf-4431-92de-5f13678dee96 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.029912 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 97/191] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.029912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.029912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.029912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.040807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0f1f1-6251-4f3d-b5f0-fceae123d94a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.051615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:30.053078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:30.082461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.083371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.083654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.083941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.085354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.086802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.088520 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 95/192] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:29 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:30.094134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.128459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 98/193] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:30.128459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.186023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.191923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d84d-80ff-42dd-8631-2b86943269ba None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.227098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.227733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.228049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.228328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.234499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bb456-067f-42ef-8bfe-f75127ad9ac3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.239681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.242448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.244385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f094b1-d167-4cd5-8aed-0511b02a320a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.248091 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 96/194] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.249514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf923-9d30-4980-ad1f-eb3883c7c106 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.249808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf923-9d30-4980-ad1f-eb3883c7c106 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.250090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abf923-9d30-4980-ad1f-eb3883c7c106 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.251356 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 97/195] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:30.252075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abf923-9d30-4980-ad1f-eb3883c7c106 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.273251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.273876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.274155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.274426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.275207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3, user.id=44caf237a06f44aaabae00d9bb71dd06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:30.275515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.276981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.283447 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 99/196] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/role_assignments?user.id=44caf237a06f44aaabae00d9bb71dd06&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=5abf87471833492b8acb0f2b8699c656 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.284247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.373875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abf923-9d30-4980-ad1f-eb3883c7c106 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.403482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0b41a-0737-475f-a61d-31752e62c40e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.418010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.418758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.419034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.419308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.422099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.435305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d1cdedc7-e47d-42f6-b93b-cbcd03c41183 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:30.440490 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:30.441521 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:30.442496 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 98/197] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:30.443321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.443321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.443452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.453373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.454905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.455191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.455468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.464538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:30.466358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:30.533963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.536561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.538060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.546221 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 99/198] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:30.548069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.640889 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 100/199] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:30.641742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.648050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e344-486a-4d4b-aac5-4cf1bf831771 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.658830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.682664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.683286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.683569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.683872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.684621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:30.684928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.686302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.694342 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 100/200] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.698918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.740718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99adf-d375-4804-9e34-f9bb149161a6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.749297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.773873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.774542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.774824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.775274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.776466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.778541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.780198 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 101/201] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.780953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.799762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944e820-5bf7-406f-a7d7-18c19ac1e100 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.831594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.832255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.832538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.832810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.834216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.835650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.837326 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 101/202] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.838059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.873346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.890564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbc9d-b2c3-4489-aa94-5b2cbd1bab10 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.923942 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.924603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.924886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.925159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.926362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.927811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:30.929453 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 102/203] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:30.929453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:30.942858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff59c-e391-4c01-a998-de25106858b7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:30.962941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:30.978524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:30.979149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:30.979433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:30.979706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:30.980425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:30.982548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.002682 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 102/204] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:30 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:31.003484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.040421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e92e-c94f-4c9b-a855-c204d3b942fc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.093934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.095026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.095447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.095958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.096782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=57e7ff3264094c20bc3815d6b22d2b4b) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:31.097094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.098558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.107695 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 103/205] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:30 2022] GET /identity/v3/role_assignments?user.id=57e7ff3264094c20bc3815d6b22d2b4b&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:31.132299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbd782-5e43-4fd3-a739-553120fa5907 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.174403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.175054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.175341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.175619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.228938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.260604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.262630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.373648 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 103/206] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:31.379097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.400068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.488879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c20d1-cbed-406a-a29a-2f2c4b08f813 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.524024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.524687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.524967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.525246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.526441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.528547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71595e-0890-4054-b75a-ba68303783f3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.530571 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 104/207] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:31.536281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:31.618323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:31.643179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a8e49-abe0-43fb-a80d-2f9f1044e080 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:31.680054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:31.680766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:31.681057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:31.681333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:31.682129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=57e7ff3264094c20bc3815d6b22d2b4b) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:31.682439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:31.684463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272370b7-5573-42a7-b5e0-13b61b3b92b5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:31.690364 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 104/208] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:31 2022] GET /identity/v3/role_assignments?user.id=57e7ff3264094c20bc3815d6b22d2b4b&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:33.173240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e60d-6287-4227-8940-96b39e048fcf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.174276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e60d-6287-4227-8940-96b39e048fcf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.174757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4e60d-6287-4227-8940-96b39e048fcf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.176358 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 105/209] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:33.181806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0614-ac10-421c-bac5-80f820c6f21f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.182595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0614-ac10-421c-bac5-80f820c6f21f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.183062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e0614-ac10-421c-bac5-80f820c6f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.202567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b91e0614-ac10-421c-bac5-80f820c6f21f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:33.204126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b91e0614-ac10-421c-bac5-80f820c6f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:33.240528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905546c-d437-450c-bb5b-3cae2509bebc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.241129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905546c-d437-450c-bb5b-3cae2509bebc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.241618 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905546c-d437-450c-bb5b-3cae2509bebc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.243168 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 106/210] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:33.249870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.250395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.250862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.269156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:33.270344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:33.277068 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 105/211] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:33.291846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca76a2-2604-4aea-827d-ba769685ad53 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.292404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca76a2-2604-4aea-827d-ba769685ad53 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.292825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca76a2-2604-4aea-827d-ba769685ad53 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.294897 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 106/212] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:33.301016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.301539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.301963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.320838 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:33.322040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:33.351210 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 107/213] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:33.360874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.383498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.390591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.404402 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 107/214] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:33.405628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.483244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08777d6-796e-41d4-975d-9b63a6344951 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.519916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.520274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4591f0-212d-483f-8ef3-db478bb3904b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.520613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.520899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.521194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.532659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:33.537653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:33.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:33.539379 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 108/215] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:33.540045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.563860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.564694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.564875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.565122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.576511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:33.581576 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:33.582426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 108/216] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:33.588368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.628202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.651156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.656619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cc9ae-8204-4996-901c-07ed65080cf6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.693702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.694608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.695038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.695446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.696867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:33.697298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebd29e-af55-4f02-a5ea-465d1fb61d92 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.698746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:33.701370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 109/217] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:33.706066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.741524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.742164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.742456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.742766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.743500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:33.743810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:33.745679 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:33.759826 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 109/218] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:33.759826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.806093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aee0b-1c66-41d1-98b4-cae208718865 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.841012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.841913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.842201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.842478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.843191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:33.843498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:33.845356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7fb7f-bf92-4095-8421-4df23a559146 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:33.853467 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 110/219] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:33.854624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91f3c-ad04-4359-993a-34255f039bd2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.854914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91f3c-ad04-4359-993a-34255f039bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.855032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8960f-364a-4a5f-b9cc-e753726af84f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:33.855194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf91f3c-ad04-4359-993a-34255f039bd2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.859982 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 111/220] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:33.859982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf91f3c-ad04-4359-993a-34255f039bd2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.861118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.883905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:33.896249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:33.896874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:33.897159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:33.897434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:33.898122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:33.899582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:33.922868 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 110/221] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:33 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:33.922868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:33.970654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf91f3c-ad04-4359-993a-34255f039bd2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.012788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.013492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.013773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.014050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.015314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.016837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd8c16-f8b7-4dcc-9f70-a1a4ab079207 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.018520 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 112/222] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.023389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.023389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.023389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.040271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:34.041550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:34.052349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27130d-b128-45c2-88f9-a4574810f6ee None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.094217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.095109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.095532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.095981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] PATH_INFO: `/v3/users/5d0eed4a359a437582ea8ea726f73766` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.113422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] RBAC: Authorizing `identity:get_user(user_id=5d0eed4a359a437582ea8ea726f73766)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.114900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.117046 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 111/223] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:33 2022] GET /identity/v3/users/5d0eed4a359a437582ea8ea726f73766 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.118482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.135056 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 113/224] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:34.136021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.138547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.157806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.248479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b121d1-c9fa-4370-9c0a-166c30cd69ba None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.283605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fa9ef-83c6-4fbe-9329-66916d8a616f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.297626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.298701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.299267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.299559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.301116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.303377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.305796 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 112/225] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.306578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.334031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.335050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.335332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.335609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.420330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.421863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.423840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.434820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c430d65-ecf0-43d6-8831-0eeb008bfc06 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.437301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.476027 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.477256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.477982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.478397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.492695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:34.500814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:34.501881 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:34.502878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:34.505437 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 113/226] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:34.507148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.539681 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 114/227] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:34.540785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.620549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd7f9d-2de4-441a-b845-27a423288c77 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.648416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05592e6-e6c8-4dea-8db7-3b96e239d9ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.658120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.658579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.659451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.659900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.660348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/57e7ff3264094c20bc3815d6b22d2b4b/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.662551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, user_id=57e7ff3264094c20bc3815d6b22d2b4b, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.664400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.688312 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 114/228] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:34 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/57e7ff3264094c20bc3815d6b22d2b4b/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:34.688614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.689281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.689854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.690194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.690641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.691080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:34.691569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.693110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.702937 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 115/229] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.709064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.742534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:34.839145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3be1e-fb98-4153-bbd8-60a6cb4a805a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.865624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7a6cc-1a08-4dfd-ae60-a4c8cdc5e205 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:34.880119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.881260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.881743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.882220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.883700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.885511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.888357 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 115/230] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.898283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:34.947686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:34.948793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:34.949360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:34.950106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:34.952349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:34.956782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:34.961985 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 116/231] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:34.967908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:35.017685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:35.058283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469020b-b11d-4ee3-a719-83029b0d3e1d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:35.064262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:35.107209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:35.107727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:35.108056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:35.108739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:35.109732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=5d0eed4a359a437582ea8ea726f73766) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:35.110153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:35.111872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:35.119116 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 116/232] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/role_assignments?user.id=5d0eed4a359a437582ea8ea726f73766&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:35.119554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda39b7-3e9f-421f-8cc0-1052297b1ae5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:35.164365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:35.165393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:35.165876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:35.166376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:35.168005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:35.170862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8394f-ff9a-425d-ab59-af4851a7b0dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:35.173380 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 117/233] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:34 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:35.181092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:35.354899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21845e-a33a-4f6a-8afe-f3abf64b1eee None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:35.406180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:35.406796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:35.407088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:35.407368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/57e7ff3264094c20bc3815d6b22d2b4b/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:35.409712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, user_id=57e7ff3264094c20bc3815d6b22d2b4b, role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:35.411172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8e7ae-7e8a-44be-96c3-b517849dde4c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:35.446914 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:35 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/57e7ff3264094c20bc3815d6b22d2b4b/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:36.314867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21dec3-cb47-4b2e-8a5e-e31db400e334 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.315409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21dec3-cb47-4b2e-8a5e-e31db400e334 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.315409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21dec3-cb47-4b2e-8a5e-e31db400e334 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.317083 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 118/235] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:36.322414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796d87-dfb9-44b6-bbb7-85772c906c47 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.322709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796d87-dfb9-44b6-bbb7-85772c906c47 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.322995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796d87-dfb9-44b6-bbb7-85772c906c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.346032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-88796d87-dfb9-44b6-bbb7-85772c906c47 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:36.347239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-88796d87-dfb9-44b6-bbb7-85772c906c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:36.359628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:36.436857 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 118/236] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:36.479000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21dec3-cb47-4b2e-8a5e-e31db400e334 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:36.576987 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6c1eb-5831-415f-a922-6a8425c94579 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.577300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6c1eb-5831-415f-a922-6a8425c94579 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.577551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6c1eb-5831-415f-a922-6a8425c94579 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.579198 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 119/237] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:36.584375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.584658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.584936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.619060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:36.620283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:36.646776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:36.656329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21dec3-cb47-4b2e-8a5e-e31db400e334 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:36.711005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:36.711711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.712026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.712311 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.713568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:36.716412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:36.718403 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 119/238] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:36.728854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:36.769454 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 120/239] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:36.817399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:36.837839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5756a81-0ac3-4aa2-9fce-e5cb402412c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:36.882379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:36.883047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:36.883338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:36.883615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:36.884539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:36.887154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:36.936435 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 120/240] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:36 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:36.955543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:36.983907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db3c4f-0619-42bf-9afb-356d5c5a267a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.026243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.027005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.027291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.028310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.041463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:37.047332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:37.048272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:37.049051 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 121/241] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:37.054879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:37.086751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:37.170262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cfad-0058-4932-96a9-e3ef96e9d1ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.206347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.206988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.207533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.207810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.208823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:37.209190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:37.210585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448367c-3ebd-4cda-867d-0ecf629f8596 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:37.219849 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 121/242] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:37.225562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:37.346964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6423-035f-428b-a095-af1c7fc3ad88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.362353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0347567-d739-4c7a-9b79-dd4fad114faf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.362838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0347567-d739-4c7a-9b79-dd4fad114faf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.362910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0347567-d739-4c7a-9b79-dd4fad114faf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.364588 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 122/243] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:37.373921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.373921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.374275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.390578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.391905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.392438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.392904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] PATH_INFO: `/v3/users/618ec23754bf4b9f94a25a5ca0347bd1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.395773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:37.395903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:37.398804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:37.414218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=618ec23754bf4b9f94a25a5ca0347bd1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:37.415846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:37.420375 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 122/244] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:37 2022] GET /identity/v3/users/618ec23754bf4b9f94a25a5ca0347bd1 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:37.430857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:37.508297 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 123/245] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:37.543200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:37.568977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:37.574268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086796-4234-4e79-b691-9124631a8ee0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.624186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.625490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.625995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.626721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.687424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb448e-e5fb-4c1d-9ac0-00e745cd4a74 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.724338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:37.732613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:37.734035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02545b0-edc7-40bd-98bd-86c2b6b3e6e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:37.737990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.738655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.738936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.739211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.753142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fb059a7b-85fe-4129-9d25-95d4d492b7c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:37.759344 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:37.760257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:37.761127 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:37.761751 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 124/246] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:37.763707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1bcb-41e1-4510-b469-074fc2992526 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.764030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1bcb-41e1-4510-b469-074fc2992526 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.764479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a1bcb-41e1-4510-b469-074fc2992526 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.767110 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 125/247] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:37.771746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1bcb-41e1-4510-b469-074fc2992526 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:37.845763 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 123/248] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:37.847124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.847353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:37.847629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:37.868750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:37.870485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:37.871746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:37.909202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a1bcb-41e1-4510-b469-074fc2992526 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:37.994064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:37.995084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:37.995583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.000989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.001240 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 124/249] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:38.003011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:38.003529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.004600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.008038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.034264 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 126/250] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:38.038900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.056357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:38.148589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9f948-6617-434e-9ef6-108ba6cd2ac8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.187518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.188231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.188518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.188793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.190054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.191510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.193404 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 125/251] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:38.193994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.222619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d890e7-1702-4590-9cfd-437a917b2666 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.258271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.258835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.259117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.259442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.260773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.262402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b554-97d6-4128-aaf1-8a3d982ca2a1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.264501 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 127/252] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:38.265499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857d648-56a7-4ae1-95ee-e65ba816aeed None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.265910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857d648-56a7-4ae1-95ee-e65ba816aeed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.266196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857d648-56a7-4ae1-95ee-e65ba816aeed None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.267415 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 128/253] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:38.268212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857d648-56a7-4ae1-95ee-e65ba816aeed None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.279298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:38.325386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:38.335628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cfb72-ee81-488b-a2cf-c8217549434e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.373142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.373948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.374064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.374325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.384833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:38.390341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:38.391863 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 126/254] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:38.392856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.406051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857d648-56a7-4ae1-95ee-e65ba816aeed None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.449140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.450464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.450681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.450963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.451765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=618ec23754bf4b9f94a25a5ca0347bd1) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:38.452564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.453663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c69f-9057-4996-bac0-a706eaf863eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.465492 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 129/255] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/role_assignments?user.id=618ec23754bf4b9f94a25a5ca0347bd1&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=5abf87471833492b8acb0f2b8699c656 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:38.465492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.465492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.465492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.495103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:38.498021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:38.586182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:38.595322 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 130/256] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:38.596535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.626229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3197c6-2789-43b3-b8bf-e2797615a361 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.681995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.682631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.682913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.683188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.714796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:38.767616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d81af6-0aa0-43a8-8c8a-8de60ffd1c7f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:38.811102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:38.812145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:38.812639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:38.813664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:38.814744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:38.815361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.817630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.827815 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 131/257] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:38.829493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:38.851392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:38.854044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:38.960361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.037719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf97117-620e-430b-8b62-7d14e82972bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.066756 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 127/258] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:39.068780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.111873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.112888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.113359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.113832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.136301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:39.141981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:39.142841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:39.143615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:39.155097 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 132/259] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:39.161330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.187961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.253344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436edba-1630-4062-8007-1f7d67bcace9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.292165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.292807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.293089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.294051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] PATH_INFO: `/v3/users/5d0eed4a359a437582ea8ea726f73766` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.295349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] RBAC: Authorizing `identity:get_user(user_id=5d0eed4a359a437582ea8ea726f73766)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.296837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.299682 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 128/260] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/users/5d0eed4a359a437582ea8ea726f73766 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.306315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.432536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d795d69-0163-4a98-a837-04a537f48e43 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.434536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdda-7e49-4161-b77f-b5bfdd438e20 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.476341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.480531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.482403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.482967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.483471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.484486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:39.485071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.486789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.496254 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 129/261] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.498617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.500794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.557185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.557878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.558160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.558436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.560231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.561685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.563770 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 133/262] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.564645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.634128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ed95-3d2a-45ec-b1e8-d9225c5fff63 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.688216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.688806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.689394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.689502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.690670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.692195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.694287 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 130/263] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.699638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.704585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4c3ee-fcb8-4c77-83f4-228721f56ec6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.743535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.744738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.745226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.745774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] PATH_INFO: `/v3/users/57e7ff3264094c20bc3815d6b22d2b4b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.747998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] RBAC: Authorizing `identity:get_user(user_id=57e7ff3264094c20bc3815d6b22d2b4b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.750006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.751069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5729-279d-4b5a-8079-af4b92df8f28 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.752998 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 134/264] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/users/57e7ff3264094c20bc3815d6b22d2b4b => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.754602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f562-48ac-4cc8-acc6-43b32cd32e43 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.755089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f562-48ac-4cc8-acc6-43b32cd32e43 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.755530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f562-48ac-4cc8-acc6-43b32cd32e43 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.757390 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 135/265] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:39.758620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f562-48ac-4cc8-acc6-43b32cd32e43 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.807230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe5eb3-e54d-4ec7-892f-0c2bc0b65ef3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.828630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:39.854208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.854833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.855157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.855441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.856844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=57e7ff3264094c20bc3815d6b22d2b4b) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:39.857162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.859108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.867085 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 131/266] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/role_assignments?user.id=57e7ff3264094c20bc3815d6b22d2b4b&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:39.867749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:39.901065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f562-48ac-4cc8-acc6-43b32cd32e43 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:39.947262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:39.948343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.948831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.950095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/5d0eed4a359a437582ea8ea726f73766/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:39.952739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, user_id=5d0eed4a359a437582ea8ea726f73766, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:39.954706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c745-2325-4619-8e8b-bfc72293cda4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:39.974372 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 136/267] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:39 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/5d0eed4a359a437582ea8ea726f73766/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:39.980015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9ebe-68d3-4f21-bfd8-8ebd6f54190c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:39.980015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9ebe-68d3-4f21-bfd8-8ebd6f54190c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:39.980015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9ebe-68d3-4f21-bfd8-8ebd6f54190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.023862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-08cc9ebe-68d3-4f21-bfd8-8ebd6f54190c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:40.025146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-08cc9ebe-68d3-4f21-bfd8-8ebd6f54190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:40.063795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e38598-70b3-4636-99f4-570271e9ea89 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.085889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.120568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.121208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.122893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.123344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.137261 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:40.144394 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15983d-3f12-44f9-a180-9e77d7a1bdf8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.144735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15983d-3f12-44f9-a180-9e77d7a1bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.145022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15983d-3f12-44f9-a180-9e77d7a1bdf8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.147064 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 138/269] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:40.152037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.152626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.153134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.181587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:40.182799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:40.219004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.220512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.232561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.261570 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 139/270] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:40.262959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.334390 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 132/271] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:40.335426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.352939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.372268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd2b82-897f-4890-bed3-6486af0ea35c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.409654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.410745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.411227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.411713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.423867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:40.433199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:40.434180 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:40.435644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:40.438323 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 140/272] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:40.439363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.455393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2b8e2-5a51-4675-9673-5dca77df6eb1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.493574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.494205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.494493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.494594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.494779 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.496203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.499024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.501114 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 133/273] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:40.501965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.573327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4602103-b5e2-42ca-bd0d-e3ee10479c4b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.598586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.613655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.614731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.615216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.615693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.617188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.618908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.620208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9a7-6126-4c9b-b11b-66426c29ae38 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.621049 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 141/274] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:40.622611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.662061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.662746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.663035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.663364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.664204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:40.664514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.665922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.680103 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 134/275] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:40.681052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.734494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10817e-222f-45f9-82a5-1483c333c9d9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.743085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:40.773495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.774134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.774492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.774843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.775711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.777381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.799513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958112a-6db5-4b93-9feb-c2dc9418e2f8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:40.803364 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 142/276] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:04:40 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:40.804369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:40.854162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:40.855205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.855753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.856416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.857503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=57e7ff3264094c20bc3815d6b22d2b4b) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:40.858044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:40.860544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2e455-d7be-4e10-8cca-b0ce8af27d24 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:40.872372 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 135/277] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/role_assignments?user.id=57e7ff3264094c20bc3815d6b22d2b4b&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:40.873429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13818-daa3-4a4f-906d-662025e4ffa3 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.873728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13818-daa3-4a4f-906d-662025e4ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.874006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13818-daa3-4a4f-906d-662025e4ffa3 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.875550 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 136/278] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:40.881821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:40.881821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:40.881821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:40.918678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:40.919959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:40.925895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.016447 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 137/279] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:41.016927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41532e-9b62-457c-9683-49b8221dd985 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.049925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.068870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.068870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.069160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.069438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] PATH_INFO: `/v3/users/14760dc586094153bcf1da86ec870fa6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.089856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] RBAC: Authorizing `identity:get_user(user_id=14760dc586094153bcf1da86ec870fa6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.091291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.093064 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 143/280] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:40 2022] GET /identity/v3/users/14760dc586094153bcf1da86ec870fa6 => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:41.098750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.130429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.186482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4b6ee-82bd-476d-94da-de646b70ab59 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.235628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.236439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.236716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.236987 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.238888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e707f-063a-4b71-b7a6-bf7358e22b6d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.247439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.251295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:41.256667 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:41.257590 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:41.258375 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:41.261821 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 138/281] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:41.268801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.310019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.311433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.311767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.312072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.313034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, user.id=14760dc586094153bcf1da86ec870fa6, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:41.313345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.314961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.322780 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 144/282] 10.222.0.47 () {56 vars in 1308 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/role_assignments?user.id=14760dc586094153bcf1da86ec870fa6&scope.system=all&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:41.403821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc699-5082-46f5-91f6-1a2e9d4fe6a5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.446445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.446884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.447176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.450323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.450323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:41.450323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.450592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.460895 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 139/283] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:41.469090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.584567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.612563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e10c-8326-440c-b845-e3bcb7ca6e87 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.662087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.662748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.663031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.663298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] PATH_INFO: `/v3/users/618ec23754bf4b9f94a25a5ca0347bd1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.664523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] RBAC: Authorizing `identity:get_user(user_id=618ec23754bf4b9f94a25a5ca0347bd1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.665958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.667863 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 145/284] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/users/618ec23754bf4b9f94a25a5ca0347bd1 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:41.673958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.769826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:41.815482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8be1-153c-4b1c-8416-ef7991e91a49 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:41.850534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:41.851096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:41.851378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:41.851653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:41.852854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:41.854292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba12de6-19b2-4975-bf8d-7365be08d6c2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:41.856198 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 140/285] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:41 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:41.861829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:41.983872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f1ed1-19e3-48f2-8c69-31d5f434c7cf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:42.020443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:42.028096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:42.028968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:42.029516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/618ec23754bf4b9f94a25a5ca0347bd1/roles/5abf87471833492b8acb0f2b8699c656` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:42.033152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, user_id=618ec23754bf4b9f94a25a5ca0347bd1, role_id=5abf87471833492b8acb0f2b8699c656)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:42.034834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a60cc-337f-4eb0-bfe3-6543b046e8a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:42.049950 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 146/286] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:04:41 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/users/618ec23754bf4b9f94a25a5ca0347bd1/roles/5abf87471833492b8acb0f2b8699c656 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:42.333555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d097-607f-4053-a517-7ed09578e980 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:42.334261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d097-607f-4053-a517-7ed09578e980 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:42.334747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422d097-607f-4053-a517-7ed09578e980 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:42.336591 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 141/287] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:42.342139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:42.342651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:42.343130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:42.364558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:42.366060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:42.375923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:42.452584 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 147/288] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:42.476412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422d097-607f-4053-a517-7ed09578e980 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:42.632137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422d097-607f-4053-a517-7ed09578e980 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:42.662714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:42.674417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:42.675070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:42.675362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:42.675642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:42.686913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:42.692573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:42.693433 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:42.694200 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 142/289] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:42.703691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:42.834694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b63d5-6c68-4070-95f2-f0a5e28ea27b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:42.880639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:42.881580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:42.882040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:42.882549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:42.883442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:42.883960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:42.885510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:42.894760 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 148/290] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:42.900583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:43.105444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea08b0-1669-4cc3-8e0f-464e9aacfc61 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:43.151494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:43.152095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.152380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.153309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] PATH_INFO: `/v3/users/5d0eed4a359a437582ea8ea726f73766` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.154517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] RBAC: Authorizing `identity:get_user(user_id=5d0eed4a359a437582ea8ea726f73766)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:43.156006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4320a78-82a9-4e8f-bc1b-7f915bb18860 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:43.157633 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 143/291] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:42 2022] GET /identity/v3/users/5d0eed4a359a437582ea8ea726f73766 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:43.163299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:43.171156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:43.326997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826c252-08ac-4875-8850-d6ebd5471a71 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:43.388240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:43.388870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.389155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.389431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.495286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:43.497333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:43.504959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:43.621034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a11d-8037-4c65-9f8d-3ae29994125b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.621589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a11d-8037-4c65-9f8d-3ae29994125b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.621589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29a11d-8037-4c65-9f8d-3ae29994125b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.623088 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 144/292] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:43.629982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e097c-2142-4d5d-a530-e1d100019e51 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.630271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e097c-2142-4d5d-a530-e1d100019e51 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.630550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e097c-2142-4d5d-a530-e1d100019e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.638648 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 149/293] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:43.644162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:43.664934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-113e097c-2142-4d5d-a530-e1d100019e51 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:43.666134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-113e097c-2142-4d5d-a530-e1d100019e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:43.752401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:43.752696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc417d35-71be-4c55-84f1-c150ddd0932d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:43.755072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:43.760783 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 145/294] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:43.774262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb563-b43b-4be1-99c8-002a10202478 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.774450 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb563-b43b-4be1-99c8-002a10202478 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.774710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eb563-b43b-4be1-99c8-002a10202478 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.776516 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 146/295] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:43.785365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.785700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.785986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.804578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:43.805984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:43.807096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:43.808181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.808779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.810196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.811428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:43.812947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:43.819250 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 150/296] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:43 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:43.819250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:43.889900 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 147/297] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:43.896764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:43.945129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfed00-f01e-47a8-9d02-5aae0d193fbf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:43.990611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:43.991666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:43.992170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:43.992665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:43.994542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:43.997540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.000429 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 151/298] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.005276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.025411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3497b1-8cbb-4e19-8ab3-483aa8288194 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.042488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.051265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.067435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.068110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.068388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.068661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.069446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=5d0eed4a359a437582ea8ea726f73766) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:44.069748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.071172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274bf54-c04f-4fd9-96a8-30cdc118aa89 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.078017 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 148/299] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:43 2022] GET /identity/v3/role_assignments?user.id=5d0eed4a359a437582ea8ea726f73766&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.079646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545367ca-db9a-4d82-8599-2008cd039095 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.079967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545367ca-db9a-4d82-8599-2008cd039095 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.080244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545367ca-db9a-4d82-8599-2008cd039095 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.085932 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 149/300] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:44.085932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545367ca-db9a-4d82-8599-2008cd039095 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.141308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb35802-283e-403c-a5dc-3f673ccf510f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.183312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.184938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.185599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.186119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.199512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:44.202262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545367ca-db9a-4d82-8599-2008cd039095 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aec033c6-4efa-4442-bc26-179813d497b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:44.206776 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:44.207706 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:44.208827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:44.211375 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 152/301] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:44.213084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6514-ab96-419c-9608-946421ad704d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.213620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6514-ab96-419c-9608-946421ad704d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.214095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b6514-ab96-419c-9608-946421ad704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.237483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a23b6514-ab96-419c-9608-946421ad704d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:44.239124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a23b6514-ab96-419c-9608-946421ad704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:44.248179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.248813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.249099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.249377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] PATH_INFO: `/v3/groups` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.250107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.251566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.273060 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 150/302] 10.222.0.47 () {60 vars in 1134 bytes} [Sun Jul 31 01:04:44 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:44.273927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.326749 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 153/303] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:44.335001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.359024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6514-ab96-419c-9608-946421ad704d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.394846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.419634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf220f-315f-4232-b0ae-023106430175 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.484103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.484740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.485078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.485633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.486124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:44.486434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.487957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.501875 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 151/304] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.507136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.508333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b6514-ab96-419c-9608-946421ad704d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.556699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.557570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.558003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.558449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.570802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:44.578064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:44.579158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:44.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:44.582742 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 154/305] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:44.588785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.629961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37439ee2-eeba-4aa0-a7e9-82074e6bc304 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.632191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.669768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.670708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.671166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.671589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] PATH_INFO: `/v3/users/2a5742fafcde4000baa1004853c563de` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.687114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] RBAC: Authorizing `identity:get_user(user_id=2a5742fafcde4000baa1004853c563de)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.688935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.691205 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 152/306] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/users/2a5742fafcde4000baa1004853c563de => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:44.697542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.704305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.716074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead56-d171-44d0-9d46-3511ba571d0a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.752722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.753344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.753614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.753890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.754601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:44.754906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.756299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af1f68-c4d3-4386-a813-f5d45a6a34b5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.765385 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 155/307] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:44.766574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2cf06-6510-48bf-872e-f98f9771bb65 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.766860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2cf06-6510-48bf-872e-f98f9771bb65 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.767137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2cf06-6510-48bf-872e-f98f9771bb65 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.768549 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 156/308] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:44.773019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2cf06-6510-48bf-872e-f98f9771bb65 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.811263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34f2b4-18d6-4122-a3f6-ae4eb2686091 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.847761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.848446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.848728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.849718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.849863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, user.id=2a5742fafcde4000baa1004853c563de, scope.system=all) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:44.850075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.851570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c0b66-d575-44f3-9eab-6dfafd7d43dd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.857427 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 153/309] 10.222.0.47 () {56 vars in 1308 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/role_assignments?user.id=2a5742fafcde4000baa1004853c563de&scope.system=all&role.id=5abf87471833492b8acb0f2b8699c656 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.857427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.857427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.857427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.881066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:44.882295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:44.894605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2cf06-6510-48bf-872e-f98f9771bb65 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:44.902299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.936014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:44.936725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:44.937009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:44.937336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] PATH_INFO: `/v3/users/14760dc586094153bcf1da86ec870fa6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:44.938643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] RBAC: Authorizing `identity:get_user(user_id=14760dc586094153bcf1da86ec870fa6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:44.940145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:44.942036 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 157/310] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/users/14760dc586094153bcf1da86ec870fa6 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:44.947858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:44.966607 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 154/311] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:44.976668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:44.994070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.066475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388d72e-fced-4235-b0fc-2d566a7ff3bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.112777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.113648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.113998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.114348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] PATH_INFO: `/v3/system/users/14760dc586094153bcf1da86ec870fa6/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.116861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=14760dc586094153bcf1da86ec870fa6, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.118607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.122568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b719889-c92e-4620-8f8e-450a678c6cb1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.130624 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 158/312] 10.222.0.47 () {58 vars in 1334 bytes} [Sun Jul 31 01:04:44 2022] PUT /identity/v3/system/users/14760dc586094153bcf1da86ec870fa6/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:04:45.170397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.171458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.172030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.172481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.186238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:45.192230 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:45.193227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:45.194012 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:45.196398 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 155/313] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:45.203709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.301552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.324012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762c5eb-451e-4dd3-91dd-19c40ae7eee0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.361936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.362796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.363301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.363723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.364630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:45.365076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.366579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.376362 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 159/314] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:45.382161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.400735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.492116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81262-08f4-410b-b224-315cc996da42 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.528972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.529729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.530022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.530299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] PATH_INFO: `/v3/users/618ec23754bf4b9f94a25a5ca0347bd1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.531577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=618ec23754bf4b9f94a25a5ca0347bd1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.533176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.534806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 156/315] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:45 2022] GET /identity/v3/users/618ec23754bf4b9f94a25a5ca0347bd1 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:45.540433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.660362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8e3f0-f855-48ec-a80f-c22361c01482 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:45.695049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:45.695740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:45.696054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:45.696333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:45.713091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.768082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:45.769544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:45.867960 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 160/316] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:45.874043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:45.959793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:45.978182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33ed53-0370-4810-b2b8-c83fd191e5d2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:46.013234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:46.013875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.014158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.014430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.015651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:46.017135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334c75b-bbef-40ea-a26a-a3b7f7753931 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:46.019087 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 157/317] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:45 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:46.024872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:46.074263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:46.131641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceebcc6-88ac-42ef-ad43-8503c147f0d6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:46.167609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:46.168311 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.168591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.168863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.169654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, scope.project.id=d6ddb43046ef4d56b9c088e41003822d, user.id=618ec23754bf4b9f94a25a5ca0347bd1) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:46.169962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:46.171388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5746ab-c18e-4573-9e4e-d0cd9d24ce8f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:46.177796 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 161/318] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:04:46 2022] GET /identity/v3/role_assignments?user.id=618ec23754bf4b9f94a25a5ca0347bd1&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=5abf87471833492b8acb0f2b8699c656 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:46.484185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab32f9-6fe0-42cd-aee5-441b7731f76c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.484489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab32f9-6fe0-42cd-aee5-441b7731f76c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.484751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab32f9-6fe0-42cd-aee5-441b7731f76c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.486247 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 158/319] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:46.491240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.491538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.491816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.509822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:46.511026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:46.579557 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 162/320] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:46.602441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab32f9-6fe0-42cd-aee5-441b7731f76c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:46.706852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab32f9-6fe0-42cd-aee5-441b7731f76c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:46.740897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:46.741541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.741825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.742157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.743302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:46.744834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd244db8-e537-43cc-b352-c375be07e149 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:46.747348 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 159/321] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:46.752921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:46.795965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:46.856086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c377-d94d-478f-9405-1d34d9554614 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:46.890408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:46.891033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:46.891317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:46.891596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] PATH_INFO: `/v3/groups` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:46.892297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:46.893804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe1a0b-694e-4e84-8fc8-340414a21ea9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:46.919966 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 163/322] 10.222.0.47 () {60 vars in 1134 bytes} [Sun Jul 31 01:04:46 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:04:47.005141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6ca1-308c-4334-9a57-2aa383c8c2e5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.005673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6ca1-308c-4334-9a57-2aa383c8c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.005673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be6ca1-308c-4334-9a57-2aa383c8c2e5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.007169 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 160/323] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:47.014011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff858d-8a7e-453f-9c01-a25c04a37680 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.014011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff858d-8a7e-453f-9c01-a25c04a37680 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.014011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff858d-8a7e-453f-9c01-a25c04a37680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.034802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90ff858d-8a7e-453f-9c01-a25c04a37680 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:47.036147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90ff858d-8a7e-453f-9c01-a25c04a37680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:47.111355 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 164/324] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:47.133513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be6ca1-308c-4334-9a57-2aa383c8c2e5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.158454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.241839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b829-c017-48fb-9f61-38b46062a68f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.242167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b829-c017-48fb-9f61-38b46062a68f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.242401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4b829-c017-48fb-9f61-38b46062a68f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.243899 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 165/325] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:47.252553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.252841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.253120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.253644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be6ca1-308c-4334-9a57-2aa383c8c2e5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.277101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:47.279626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:47.295563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.296265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.296559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.296829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.310350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.310552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:47.316447 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:47.317338 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:47.318159 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 161/326] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:47.323259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.374239 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 166/327] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:47.405591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.422276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.445761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066d714-3eee-42a5-b30b-159a57a21cad None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.482627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.483256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.483568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.484152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.484900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:47.485262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.486727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.496104 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 162/328] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:47.502247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.524896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67c234-3b21-4cb3-96ee-40954cad5be5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.571178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.574504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.574504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.574504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.589660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:47.604936 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:47.606644 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:47.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:47.610194 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 167/329] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:47.616787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.632376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be476-798a-45b6-9de4-1cb34bd5cbe9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.646159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.695305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.695988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.696518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.696804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] PATH_INFO: `/v3/users/2a5742fafcde4000baa1004853c563de` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.698415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=2a5742fafcde4000baa1004853c563de)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.700249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.702838 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 163/330] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/users/2a5742fafcde4000baa1004853c563de => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.711976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.723366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:47.786082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f15519-7a5c-49e1-aee9-c6eed8bd7901 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.842309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.842919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.843138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.843406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.844230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:47.844538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.845917 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.869478 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 168/331] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:47.878896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:47.887802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4817a-c974-4c5b-b5ae-55a2a142b0e8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:47.964492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:47.965214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:47.965498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:47.965848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] PATH_INFO: `/v3/system/users/2a5742fafcde4000baa1004853c563de/roles/5abf87471833492b8acb0f2b8699c656` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:47.968983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a5742fafcde4000baa1004853c563de, role_id=5abf87471833492b8acb0f2b8699c656)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:47.970374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:47.992110 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 164/332] 10.222.0.47 () {58 vars in 1334 bytes} [Sun Jul 31 01:04:47 2022] PUT /identity/v3/system/users/2a5742fafcde4000baa1004853c563de/roles/5abf87471833492b8acb0f2b8699c656 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:04:48.020955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:48.042727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df193d54-d9f4-4202-85f4-f8f6f65eea74 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:48.084007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:48.084677 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:48.084976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:48.085244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] PATH_INFO: `/v3/users/14760dc586094153bcf1da86ec870fa6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:48.086469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] RBAC: Authorizing `identity:get_user(user_id=14760dc586094153bcf1da86ec870fa6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:48.088035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810890b5-7816-4102-949c-635ce2db8c98 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:48.095424 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 169/333] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:47 2022] GET /identity/v3/users/14760dc586094153bcf1da86ec870fa6 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:48.096800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:48.179434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:48.214920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f42-9016-4196-b6d7-1131b5af767f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:48.257065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:48.257692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:48.257976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:48.258244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:48.259037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] RBAC: Adding query filter params (role.id=d09d72d9798848e69a01f18d4ae181e4, user.id=14760dc586094153bcf1da86ec870fa6, scope.system=all) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:48.259344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:48.260871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03b72-3198-4eef-87e9-ddf7b0d8702d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:48.276405 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 165/334] 10.222.0.47 () {56 vars in 1308 bytes} [Sun Jul 31 01:04:48 2022] GET /identity/v3/role_assignments?user.id=14760dc586094153bcf1da86ec870fa6&scope.system=all&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:49.760037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e48e-6b77-4143-ae7f-d76f61eedf90 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.760689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e48e-6b77-4143-ae7f-d76f61eedf90 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.760689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e48e-6b77-4143-ae7f-d76f61eedf90 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.762203 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 170/335] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:49.767392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.767924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.768103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.786759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6a60-c510-4468-b6f4-6d25a133808c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.787088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6a60-c510-4468-b6f4-6d25a133808c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.787315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df6a60-c510-4468-b6f4-6d25a133808c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.788958 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 171/336] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:49.797593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:49.797894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:49.798140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:49.808778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:49.810532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.831558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:49.832823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:49.956803 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 166/337] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:49.977427 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 172/338] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:49.992245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.019401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.068164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.112057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62d74-adbf-4021-80a0-669a9b363d16 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.149857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.150497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.150788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.151062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.161549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:50.166640 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:50.167479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:50.168858 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 167/339] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:50.174107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.197702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.246144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1264057-ab37-487e-827e-4fd273e2af4d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.281070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769ad00-b580-4e5b-8867-d36378f4dc88 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.301832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.317961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.318576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.318859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.319131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.319856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:50.320191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.321690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.330742 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 168/340] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:50.336588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.336718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.337506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.337789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.338066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.360557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:50.365574 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:50.366430 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:50.367636 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 173/341] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:50.373824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.445815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac8e2d-05af-4075-9d0c-2128837fa588 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.505625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.506247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.506856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.507135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.587076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9a56-0a29-4ea1-9c19-4efc47cde8e2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.606296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.634270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.636741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.655663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.656312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.656658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.656932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.657699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:50.658003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:50.659477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:50.675394 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 174/342] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:50.681809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.688724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.803187 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 169/343] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:50.809858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:50.873816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce0bb5-7313-48f1-90a7-48bae2ee701d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:50.928369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:50.933613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:50.934302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:50.934583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:50.934850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:50.950576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097aff5b-ef73-476b-a5f6-18158455bfb9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.017553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.018265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.018554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.018835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.020100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.021557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.022300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.023570 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 170/344] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.023770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2755473-7fff-412f-9e4b-6eb305bfa0ae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.030170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.032437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.158246 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 175/345] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:51.159304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeeb5b-7a45-4db9-9c53-69d33eb4d3cd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.159593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeeb5b-7a45-4db9-9c53-69d33eb4d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.159874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeeb5b-7a45-4db9-9c53-69d33eb4d3cd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.162424 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 176/346] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:51.164099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03609c-59da-4862-a8e4-8b1acd456b30 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.164411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03609c-59da-4862-a8e4-8b1acd456b30 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.164692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03609c-59da-4862-a8e4-8b1acd456b30 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.166700 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 177/347] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:51.167856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03609c-59da-4862-a8e4-8b1acd456b30 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.199256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0284c-fdb6-4f6e-8913-53d09ec1b099 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.243162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.243870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.244195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.244471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.251541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.253040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad17e7-3c11-4c09-8eb9-5b8a820a3a0a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.255014 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 171/348] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:51.256223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.256506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.256783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.280584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:51.281830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:51.292047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.299884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03609c-59da-4862-a8e4-8b1acd456b30 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.302283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.341288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.341940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.342221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.342499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.343695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.345187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877587c-cf58-432b-9299-04e0a8e8d9a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.346866 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 178/349] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.348018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.348307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.348583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.358938 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 172/350] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:51.359640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.367858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:51.369244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:51.453047 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 179/351] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:51.453922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.469167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c38e-3a5f-4660-99ee-5dff7e4ea608 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.508441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.509065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.509344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.509616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.510409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:51.510716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.512720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.519014 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 173/352] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.519822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.533746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.561629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.565093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689df65-93e9-4ecf-bf66-1ca9723b76d6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.627157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.627998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.628303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.628583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.630236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.632324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.634573 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 180/353] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.635215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.645683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478868b2-cf6c-40b5-a3d1-5b393ed257a1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.694982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.695561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.695841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.696159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.708130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8448d497-4fa9-4642-ae35-d7db2e4dd6cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:51.713559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:51.714530 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 174/354] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:51.719525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137712e0-85ef-4415-8754-f85db6a47e79 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.721533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137712e0-85ef-4415-8754-f85db6a47e79 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.721533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137712e0-85ef-4415-8754-f85db6a47e79 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.721533 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 175/355] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:51.721533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137712e0-85ef-4415-8754-f85db6a47e79 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.773433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7462c-68f0-4523-a71b-1a699a8962b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.809912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.825322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.826423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.827402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.827975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.843827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:51.852139 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:51.853020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:51.853781 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:51.855284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137712e0-85ef-4415-8754-f85db6a47e79 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:51.856493 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 181/356] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:51.860996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:51.900562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:51.912476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:51.913151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.913436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.913706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.914500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:51.914803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:51.916330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05865e-5ff0-4d8c-9adc-3fd27935941c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:51.922835 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 176/357] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:51.924207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:51.924495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:51.924769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:51.956323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:51.958064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:52.005315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc9e6-66ef-4ce5-aa02-13ff6879ae54 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.067123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.068287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.068798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.069274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.070310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:52.070819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:52.072569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8350781-2973-4247-bb56-64c37875a9a2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:52.079753 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 177/358] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:52.080884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.085330 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 182/359] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:52.087108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c45d1-dbf3-4cf6-8725-056d9f1c07e6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.087589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c45d1-dbf3-4cf6-8725-056d9f1c07e6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.088183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c45d1-dbf3-4cf6-8725-056d9f1c07e6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.090108 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 183/360] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:52.091054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c45d1-dbf3-4cf6-8725-056d9f1c07e6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.159805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.210892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ed878-fbdb-4ec9-8401-8ac6b4598843 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.215806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.230423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c45d1-dbf3-4cf6-8725-056d9f1c07e6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.257837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.258460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.258742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.259015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.259765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:52.260641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:52.262836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bb589-c9d7-47d3-8af5-65c61c196d2b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:52.274706 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 178/361] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:52.280047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.280047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.280047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.283786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.284533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.284808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.285137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] PATH_INFO: `/v3/users/2a5742fafcde4000baa1004853c563de` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.286342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a5742fafcde4000baa1004853c563de)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:52.287795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:52.290169 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 184/362] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/users/2a5742fafcde4000baa1004853c563de => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:52.290281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.300599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:52.302304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:52.378146 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 179/363] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:52.379315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.407999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bda85-0187-4f68-ae18-4312360f65b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.444406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.444406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.444661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.451011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.459683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:52.465650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:52.466806 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:52.467591 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 185/364] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:52.468279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.469415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.491422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.523277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee141739-2e1b-466a-ad25-b420eb8b26ab None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.575420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.576476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.576831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.577632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.607245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a49f7a-06ac-41cd-8dd0-3bf2d248c6ad None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.656152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.656896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.657472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.657751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.658253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:52.658548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] RBAC: Adding query filter params (role.id=5abf87471833492b8acb0f2b8699c656, user.id=2a5742fafcde4000baa1004853c563de, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:52.658858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:52.660318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:52.661044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:52.677322 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 186/365] 10.222.0.47 () {56 vars in 1308 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/role_assignments?user.id=2a5742fafcde4000baa1004853c563de&scope.system=all&role.id=5abf87471833492b8acb0f2b8699c656 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:52.678647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.764374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.837297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:52.863034 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 180/366] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:52.864206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:52.892466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851e06c-e597-4355-bd9f-ca7cbf631eea None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:52.938015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:52.938744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:52.938937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:52.939210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:52.960588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:52.969103 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:52.970029 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:52.970803 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 187/367] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:52.971471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.018205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f15f9-b6e9-4c12-98cb-e8981dd97da0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.066267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.066924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.067214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.067488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.068249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:53.068553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.069984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.080387 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 181/368] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.081125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.106967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.107797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27704e39-ed9f-4f27-a7fa-e623e3e9ab2a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.158351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.159006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.159295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.159573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.160793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.162251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.163953 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 188/369] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:52 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.164719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.170409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.211816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f9ef7-2fdc-45d9-bfa2-dbde6ab2c5a7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.249746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.250384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.250664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.250937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.251666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:53.251993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.253368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.262901 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 182/370] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.264786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.280036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847cb21-03d5-4263-9bae-309a764a815e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.318359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.319005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.319297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.319580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.353484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.378933 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820463a-1935-49e2-885c-a289113bf952 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.397216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.398682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.413383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.416128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.416865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.417222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.417566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.419681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.421310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.427862 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 183/371] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.428788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.523493 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 189/372] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:53.524732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.544352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1814-9ba5-4bb1-a2e6-4cd59882e66c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.582366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.583225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.583990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.584478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.600785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.630873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b4117-61c8-4e01-9899-c096538a366d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.656326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.659331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.660992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.672104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.672904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.673333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.673704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.674703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=d6ddb43046ef4d56b9c088e41003822d) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:53.675053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.676748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.691973 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 190/373] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.691973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.808051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56ff16-65e8-48c7-a5fd-0735c30a4c62 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:53.826551 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 184/374] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:53.833034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.842787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:53.843456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:53.843742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:53.844059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:53.845278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:53.846780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:53.849053 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 191/375] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:53.856659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:53.936325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:53.937193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.014657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bc388-0a4f-4ca4-9790-60d16c42d3ca None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.061919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.062098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fff41-cfbf-476d-a497-eaa758c26b14 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.063643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.064165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.064695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] PATH_INFO: `/v3/projects/764484e0c3894629816e00d4d75ffb98` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.066148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] RBAC: Authorizing `identity:get_project(project_id=764484e0c3894629816e00d4d75ffb98)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.068848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606a507-be09-4a0c-87a7-5a8465be5894 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.071262 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 185/376] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/projects/764484e0c3894629816e00d4d75ffb98 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.080544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29f64-b1f1-42d1-97d0-d941825262c7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.081124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29f64-b1f1-42d1-97d0-d941825262c7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.081739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e29f64-b1f1-42d1-97d0-d941825262c7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.084256 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 186/377] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:54.085325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e29f64-b1f1-42d1-97d0-d941825262c7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.115204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.116235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.116721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.117197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.118701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.121017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a285000-8a35-4120-aa67-e541c9a9cffc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.124298 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 192/378] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:53 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.130367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.130922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.131045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.151324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:54.153521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:54.227252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e29f64-b1f1-42d1-97d0-d941825262c7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.242029 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 193/379] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:54.243731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.250966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.283478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.285374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.286939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.288702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] PATH_INFO: `/v3/groups/4aa2acbea0ea4103b18e61bf1115efab` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.298891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.303213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] RBAC: Authorizing `identity:get_group(group_id=4aa2acbea0ea4103b18e61bf1115efab)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.304742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.306606 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 187/380] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/groups/4aa2acbea0ea4103b18e61bf1115efab => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.307548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.384877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51601c0-4ea9-4264-8d6c-110c3bd31e50 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.434825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.435972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.435972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.436288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.437087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=d6ddb43046ef4d56b9c088e41003822d) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:54.437398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.438841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.442084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f8a70-c21a-4250-a75f-f8beed65f44a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.451414 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 194/381] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.455439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.511172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.512482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.512922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.513404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.531187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2e8ad912-834e-4771-9c36-6e3da34b8de1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:54.536737 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:54.537689 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 188/382] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:54.542961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad632-9d7c-49ee-b8dd-ea443d300cc1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.544751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad632-9d7c-49ee-b8dd-ea443d300cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.544751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cad632-9d7c-49ee-b8dd-ea443d300cc1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.544751 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 189/383] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:54.549173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.549436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.549632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.570855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:54.571759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:54.610319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.615953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.624133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a2076-f0ac-40c2-8e3a-3bba0289ebe9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.662577 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 190/384] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:54.663813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.664309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.664695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.665071 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.665392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.666055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] RBAC: Adding query filter params (group.id=4aa2acbea0ea4103b18e61bf1115efab, role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=764484e0c3894629816e00d4d75ffb98) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:54.666490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.668306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.674189 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 195/385] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/role_assignments?group.id=4aa2acbea0ea4103b18e61bf1115efab&scope.project.id=764484e0c3894629816e00d4d75ffb98&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.694693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.792249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775ef7-d7e8-43a8-a874-8467a291fc3b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.855230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.856813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.857415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.857943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.858923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:54.859484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:54.866828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:54.879257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a78fd-8f4e-46ee-ab49-b94b5b21be48 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:54.884443 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 191/386] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:54.893878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.929313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:54.930369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:54.930874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:54.931434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:54.937889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:54.947040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:54.953894 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:54.954787 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:54.955587 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:54.958352 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 196/387] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:54.966767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:54.996957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:55.047797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612347d-1020-4459-abbe-3ca0af8d0f0c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.100805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33fc55-e9e3-449c-a8e6-5eb85ff326ce None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.103859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.104811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.105296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.106353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.107972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.109842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.111796 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 192/388] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:55.117594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:55.176956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.177591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.177932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.178240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.178940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:55.179247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.180705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.193371 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 197/389] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:55.199048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:55.283967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:55.288647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f4e0-5c99-4050-9ccc-d0b2c6e2a0c4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.359804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.360487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.360771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.361046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.362899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.365587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.370363 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 193/390] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:55 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:55.376238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:55.380246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:55.405595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb5d66-5845-4046-9d72-05f57d534ca7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.472676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.473341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.473631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.473905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.475149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.476633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.478674 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 198/391] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:55 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:55.487902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:55.538449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee81c-90e8-4cb7-bec0-e55242d1d16a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.607612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.608855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.610321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.610992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.614566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, group_id=16061d8b2c204fc3961e7fa9c61c1a34, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.618869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.644992 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 194/392] 10.222.0.47 () {58 vars in 1442 bytes} [Sun Jul 31 01:04:55 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:04:55.684534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e11d-e44f-489d-8cb8-ff58caa246d3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.745348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.745936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.746259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.746537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.747840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.749420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566036-e733-4f65-b6e4-3ba2994ffee1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.751448 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 199/393] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:55 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:55.757491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:55.792788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:55.882279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c635c-266f-41df-84cc-64ed9a387778 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:55.922178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:55.923247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:55.923759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:55.924271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:55.926786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3, group_id=16061d8b2c204fc3961e7fa9c61c1a34, role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:55.928470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19b61d-892b-4b9b-9d4c-6bfdf5e2ff42 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:55.944384 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 195/394] 10.222.0.47 () {58 vars in 1442 bytes} [Sun Jul 31 01:04:55 2022] PUT /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:56.140734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3f05-7bc2-4f95-b96e-bcdad5e6ab31 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.141258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3f05-7bc2-4f95-b96e-bcdad5e6ab31 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.141336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3f05-7bc2-4f95-b96e-bcdad5e6ab31 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.142796 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 200/395] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:56.147972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.148505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.149005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.169269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:56.170786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:56.261810 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 196/396] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:56.293940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3f05-7bc2-4f95-b96e-bcdad5e6ab31 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:56.327875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:56.431581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3f05-7bc2-4f95-b96e-bcdad5e6ab31 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:56.479442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:56.480125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.480462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.481448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.497396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:56.502890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:56.503754 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:56.504571 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 201/397] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:56.510012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:56.537642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:56.637725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252490df-81e6-40a4-88d6-2fd62ad982df None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:56.675619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:56.676600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.677111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.677538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.678410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] RBAC: Adding query filter params (name=member) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:56.678865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:56.680410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:56.690478 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 197/398] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:56.695797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:56.818101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:56.843312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f81-bf16-4a83-87c9-7e52a16fc56b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:56.886519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:56.887349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:56.887633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:56.887901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:56.889158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:56.890586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:56.892543 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 202/399] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:56 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:56.898020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.019420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:57.048388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230b307-9209-4a46-8866-fb4f88127581 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.099034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.099688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.099995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.100281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.101494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:57.102945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd871d-f3d8-42f3-af29-f722cff0258d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:57.104658 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 198/400] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:56 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:57.111167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.259721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abc19-5089-4d47-ade7-6b3d3633cda3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.271183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665130-6e26-4988-a057-53bc5df1c3ed None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.271476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665130-6e26-4988-a057-53bc5df1c3ed None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.271670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae665130-6e26-4988-a057-53bc5df1c3ed None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.273216 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 199/401] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:57.279338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.279621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.279901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.315366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:57.316241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.316583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:57.317388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.317872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.318357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.320572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, group_id=16061d8b2c204fc3961e7fa9c61c1a34, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:57.322213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd330-cb2c-4cfa-9084-f1b0166f3c4e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:57.338918 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 203/402] 10.222.0.47 () {58 vars in 1442 bytes} [Sun Jul 31 01:04:57 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:57.340568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48883-0b8e-4c68-b774-c4111514c659 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.341184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48883-0b8e-4c68-b774-c4111514c659 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.341699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf48883-0b8e-4c68-b774-c4111514c659 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.343260 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 204/403] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:57.353937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.354583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.355075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.379011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:57.381004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:57.394950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:57.469672 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 200/404] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:57.477326 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 205/405] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:04:57.517793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.518667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.643620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d609ea-640b-4b8d-9f20-c8ab52bb276f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.658307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:57.688730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.689347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5c170-f05c-464f-84d1-f51e04f6d322 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.689467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.689675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.689952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.700459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:57.709181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:57.716287 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:57.717217 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:04:57.718034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:57.719704 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 206/406] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:04:57.723725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.744020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.744670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.745259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.745543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.760875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:57.767227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:57.768137 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:57.768917 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:57.772162 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 201/407] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:57.774708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.887577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b87-09af-4371-94f1-c1fa6db5f352 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.904070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051483f-791f-446c-9fa4-ea777fcb536d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:57.944019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.944345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:57.944665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.944934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:57.945127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.945277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:57.945425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.945565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:57.946001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:57.946175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:57.946360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:57.946523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:57.947758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:57.947961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:57.951031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:57.964020 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 202/408] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:57.966437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:57.978068 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 207/409] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:58.001001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.081674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea9ca5-d3da-42d4-874d-3fcf12469b2e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.109225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:58.119626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.120298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.120585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.120859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.122830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.124331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.130414 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 203/410] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:58.131594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.171597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2fb1-b855-4018-bbc4-6371024b117c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.198301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:58.230246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.231564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.231914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.232211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] PATH_INFO: `/v3/groups/4aa2acbea0ea4103b18e61bf1115efab` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.235461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04277932-36f5-4996-9b04-b32386f16e2c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.236664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] RBAC: Authorizing `identity:get_group(group_id=4aa2acbea0ea4103b18e61bf1115efab)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.238359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.240027 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 208/411] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:04:57 2022] GET /identity/v3/groups/4aa2acbea0ea4103b18e61bf1115efab => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:58.255335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.275352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.276087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.276371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.276649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.277859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.279309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.281015 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 204/412] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:58 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:58.286785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.412286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ecdd4-dc00-4bd0-ab15-d33830bd4f82 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.459500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.460210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.460492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.460768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.463064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] RBAC: Authorizing `identity:create_grant(project_id=d6ddb43046ef4d56b9c088e41003822d, group_id=16061d8b2c204fc3961e7fa9c61c1a34, role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.464708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.469091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:58.481864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f2ce7-3678-477b-9ff9-dae66bc2adab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.488570 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 205/413] 10.222.0.47 () {58 vars in 1442 bytes} [Sun Jul 31 01:04:58 2022] PUT /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d/groups/16061d8b2c204fc3961e7fa9c61c1a34/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:04:58.557168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:58.571202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.571880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.572192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.572524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] PATH_INFO: `/v3/projects/764484e0c3894629816e00d4d75ffb98` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.576464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] RBAC: Authorizing `identity:get_project(project_id=764484e0c3894629816e00d4d75ffb98)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.577987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b475a9-6a6c-441e-9dfb-ee86f2a80954 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.580209 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 209/414] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:58 2022] GET /identity/v3/projects/764484e0c3894629816e00d4d75ffb98 => generated 344 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:04:58.586406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.602526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680690b-0be1-4b49-92a4-04ee5a08d38c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.602845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680690b-0be1-4b49-92a4-04ee5a08d38c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.603090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680690b-0be1-4b49-92a4-04ee5a08d38c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.604515 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 210/415] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:04:58.610700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534614-50a3-470e-8595-fc48c73229c5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.611034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534614-50a3-470e-8595-fc48c73229c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.611322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44534614-50a3-470e-8595-fc48c73229c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.631512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-44534614-50a3-470e-8595-fc48c73229c5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:58.632819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-44534614-50a3-470e-8595-fc48c73229c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:58.710053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f4ea3-26eb-44df-a7c8-0e3d6aa159ec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.747262 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 211/416] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:58.748613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bbef5-0eb6-4402-8fd1-3af079f1a5b8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.748912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bbef5-0eb6-4402-8fd1-3af079f1a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.749193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bbef5-0eb6-4402-8fd1-3af079f1a5b8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.750693 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 212/417] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:04:58.756108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.756404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.756701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.758438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:58.759391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:58.759993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:58.760560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] PATH_INFO: `/v3/projects/764484e0c3894629816e00d4d75ffb98/groups/4aa2acbea0ea4103b18e61bf1115efab/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:58.763604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=764484e0c3894629816e00d4d75ffb98, group_id=4aa2acbea0ea4103b18e61bf1115efab, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:58.766477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:58.779673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:04:58.781076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:04:58.788037 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 206/418] 10.222.0.47 () {58 vars in 1442 bytes} [Sun Jul 31 01:04:58 2022] PUT /identity/v3/projects/764484e0c3894629816e00d4d75ffb98/groups/4aa2acbea0ea4103b18e61bf1115efab/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:04:58.789308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:58.883250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:58.934342 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 213/419] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:04:58.952873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71366e0c-f091-4791-976e-dc61800705b1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:58.968216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.002219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.002891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.003180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.003456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.015660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:59.021365 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:59.022427 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:04:59.023573 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 207/420] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:04:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:59.029494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.047065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.123048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24011efb-892d-4a01-9c16-b3aee3e09892 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.161488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.162285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.162576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.162854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.175579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:04:59.181406 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:04:59.183482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:04:59.185715 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 214/421] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:04:59.187267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d785284-45e0-4e09-a8a5-1b34288a3181 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.191951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.219829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.285362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.285362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.285362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.285362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.285783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:59.285783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:59.287091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:59.303617 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 208/422] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:59.310122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.317671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017be5ac-a9a7-442e-9af7-21490bd9a6d2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.356309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.385703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.386328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.386609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.387875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.388625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:04:59.388929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:59.391550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:59.405903 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 215/423] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:04:59.410082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.504337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c68d4-2c45-4245-bd39-992f0fb9a95b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.566967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.567589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.567871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.568171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.598055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3897b2e-20e2-4ad0-adef-2f16c0135565 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:04:59.645107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.662273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:04:59.662905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:04:59.663270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:04:59.663543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:04:59.685274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:59.686731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:59.764891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:04:59.792016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:04:59.793507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:04:59.874675 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 209/424] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:04:59.879772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:04:59.934644 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 216/425] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:04:59.942441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.039887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.057610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.067953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ba71-441b-45bf-a501-cc8c0727869b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.088025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767392c-cfec-4d97-aeec-c529c6ebd297 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.110829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.111468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.111753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.112058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.113328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.114624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c357f3-b7d9-4610-866a-0d682c980a2b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.120880 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 210/426] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:00.122297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00819b4-66fb-4194-973d-c74e578ec848 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.122659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00819b4-66fb-4194-973d-c74e578ec848 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.122848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00819b4-66fb-4194-973d-c74e578ec848 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.124505 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 211/427] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:00.128748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00819b4-66fb-4194-973d-c74e578ec848 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.134137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.135070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.135578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.136089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] PATH_INFO: `/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.138218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] RBAC: Authorizing `identity:get_project(project_id=3f0699f49d9143b7ba61b4fa1b0dd4a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.140443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1782a-1970-4da9-9a17-b2501fa8db20 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.143580 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 217/428] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:04:59 2022] GET /identity/v3/projects/3f0699f49d9143b7ba61b4fa1b0dd4a3 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.149559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.149848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.150108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.170421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:00.171608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:00.244459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 218/429] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:00.250152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.258822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00819b4-66fb-4194-973d-c74e578ec848 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.304872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.305431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.305711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.306081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.308265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.311711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.317460 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 212/430] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.318567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.334238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.361429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.387881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60944707-2241-49eb-9b61-1a7a9e41c79e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.426170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.426768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.427048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.427374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.429893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43213a1-9a4f-4a28-a4b0-857ac5779e79 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.430992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.432553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.435139 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 219/431] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.439890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.475319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.476405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.476905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.477385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.489672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:00.495076 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:00.495988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 31 01:05:00.497434 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:00.499986 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 213/432] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:00.500992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.559566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfd50-77de-473f-8259-36feed8cc15b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.578572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.598565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.599225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.599454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.599726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.600539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:00.600843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.602362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.615283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146038e-e48e-4f85-8730-5dd59ce531b3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.616106 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 220/433] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.617279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.636421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.670425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.671449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.671977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.672459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.673461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:00.673997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.675697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.689875 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 214/434] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=3f0699f49d9143b7ba61b4fa1b0dd4a3&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.753521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029cb84-ac79-497d-81e0-5264b146160e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.795441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.796180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.796463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.796735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.797460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:00.797762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:00.799139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efc5d3-c5a7-41f6-8439-c12cf003afcf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:00.814301 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 221/435] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:00.815968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:00.940332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe8520-7ce3-415d-a899-97325d940231 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:00.962874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-e5fe-4292-9384-a36d3708e81d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.963338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-e5fe-4292-9384-a36d3708e81d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.963621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eaf3f-e5fe-4292-9384-a36d3708e81d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.965582 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 222/436] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:00.971162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822da25-28f5-48e4-9f3b-e3198ac435ef None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.971448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822da25-28f5-48e4-9f3b-e3198ac435ef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.971728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822da25-28f5-48e4-9f3b-e3198ac435ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.984659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:00.985609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:00.986106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:00.986576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:00.990656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:00.999324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a822da25-28f5-48e4-9f3b-e3198ac435ef None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:01.001048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a822da25-28f5-48e4-9f3b-e3198ac435ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:01.078270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.080603 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.105237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.111070 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 223/437] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:01.112196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeec4d-347e-49ba-889e-823f73d14270 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.112488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeec4d-347e-49ba-889e-823f73d14270 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.112766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aeec4d-347e-49ba-889e-823f73d14270 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.114025 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 224/438] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:01.120724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.121174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.121502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.143215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:01.144518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:01.218608 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 215/439] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:01.219491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.220818 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 225/440] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:01.224228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.265955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.346673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871495df-b288-40b0-80e4-2dfbcc0baed3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.347178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c11790-d136-4cfb-aa95-18cd31d9a313 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.384282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.390883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.391541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.391823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.392173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.392342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.392961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.393248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.393531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.394708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.396817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.398153 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 226/441] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.403743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:01.404005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:01.409488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:01.410379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:01.411185 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 216/442] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:01.411843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.507235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.510706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15403d0-65ef-41a5-9882-0fb96be79888 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.514117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce7a98-eb15-4073-ad39-dc916f1c3ac5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.546614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.547248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.547533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.547812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.548958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.549598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.549883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.550156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.551308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.552778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.554368 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 217/443] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.555122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.558289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:01.564076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:01.564981 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 227/444] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:01.570892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.624797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.658484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f3df7-6a31-4ade-87e8-ce84b8b14f2c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.667502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492b9fb-0e92-47aa-b2f9-c20dbbfa5e1d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.693841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.694461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.694744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.695019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.695733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:01.696068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.697487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.701464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.702070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.702351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.702625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.703399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=d09d72d9798848e69a01f18d4ae181e4, scope.project.id=d6ddb43046ef4d56b9c088e41003822d) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:01.703712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.705190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 218/445] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.707452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.715965 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 228/446] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=d09d72d9798848e69a01f18d4ae181e4 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.716790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.741092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.836726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0f8b9-539e-4bda-ae1c-dc01a53dca8e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.843048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adcea5-7b9e-4624-a532-9097b3a99e8e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:01.864597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:01.878747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.879313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.879624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.879884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.884781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:01.885406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:01.885692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:01.885970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:01.886692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:01.887668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.889079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:01.898947 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 219/447] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:01.905126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:01.966835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:01.968356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.008717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.027258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c55c7f-2f64-4c68-a7f3-645557a6b879 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.066767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.067398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.067682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.068031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.094672 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 229/448] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:02.100297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.123273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.138153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.139552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.200131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2acc-a0b4-46ce-a66d-90856841064c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.225216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.234846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.235493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.235776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.236092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] PATH_INFO: `/v3/projects/d6ddb43046ef4d56b9c088e41003822d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.237262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] RBAC: Authorizing `identity:get_project(project_id=d6ddb43046ef4d56b9c088e41003822d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.238586 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 220/449] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 31 01:05:02.238705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.244602 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 230/450] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/projects/d6ddb43046ef4d56b9c088e41003822d => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:02.244725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.245527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.333490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.341853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196938ab-ef0a-4b08-b33e-ba48715240eb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.344431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a55625-4027-4e91-b1d6-16141970a06a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.375373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.376025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.376308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.376582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] PATH_INFO: `/v3/projects/764484e0c3894629816e00d4d75ffb98` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.377720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] RBAC: Authorizing `identity:get_project(project_id=764484e0c3894629816e00d4d75ffb98)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.378892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.379161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.379530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.379815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.380130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] PATH_INFO: `/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.380836 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 221/451] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/projects/764484e0c3894629816e00d4d75ffb98 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:02.381283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] RBAC: Authorizing `identity:get_group(group_id=16061d8b2c204fc3961e7fa9c61c1a34)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.382706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.389609 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 231/452] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/groups/16061d8b2c204fc3961e7fa9c61c1a34 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:02.389726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.390440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.443175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.488454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2fcc-e7a9-474a-9686-1b4bb638ff7b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.488986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93c6f3-465c-4e0a-b4aa-1d072609659f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.522797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.522994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.523474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.523591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.523755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.523852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.524057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] PATH_INFO: `/v3/groups/4aa2acbea0ea4103b18e61bf1115efab` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.524169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.524886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] RBAC: Adding query filter params (group.id=16061d8b2c204fc3961e7fa9c61c1a34, role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=d6ddb43046ef4d56b9c088e41003822d) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:02.525198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.525286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] RBAC: Authorizing `identity:get_group(group_id=4aa2acbea0ea4103b18e61bf1115efab)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.526637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092589d-5dcd-45d8-a782-be0d4e896ac4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.526734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.529031 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 222/453] 10.222.0.47 () {56 vars in 1180 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/groups/4aa2acbea0ea4103b18e61bf1115efab => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:02.533684 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 232/454] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/role_assignments?group.id=16061d8b2c204fc3961e7fa9c61c1a34&scope.project.id=d6ddb43046ef4d56b9c088e41003822d&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:02.534754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:02.643220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f0cf-efec-4b3e-ad12-2f20cad3af23 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:02.668433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:02.679343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:02.680047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:02.680266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:02.680536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:02.681325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] RBAC: Adding query filter params (group.id=4aa2acbea0ea4103b18e61bf1115efab, role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=764484e0c3894629816e00d4d75ffb98) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:02.681639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:02.683056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207228c-60c7-4dd7-b677-07ff64de4583 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:02.690199 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 223/455] 10.222.0.47 () {56 vars in 1376 bytes} [Sun Jul 31 01:05:02 2022] GET /identity/v3/role_assignments?group.id=4aa2acbea0ea4103b18e61bf1115efab&scope.project.id=764484e0c3894629816e00d4d75ffb98&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:05.047000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888a38-ec68-4348-996a-d5f2bcec3243 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.047531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888a38-ec68-4348-996a-d5f2bcec3243 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.047531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89888a38-ec68-4348-996a-d5f2bcec3243 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.049183 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 233/456] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:05.054532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e75f-73e3-4d00-9a5f-a4666d8ebafb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.055363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e75f-73e3-4d00-9a5f-a4666d8ebafb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.055891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e75f-73e3-4d00-9a5f-a4666d8ebafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.081013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1240e75f-73e3-4d00-9a5f-a4666d8ebafb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:05.082254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1240e75f-73e3-4d00-9a5f-a4666d8ebafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:05.179447 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 224/457] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:05.220876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89888a38-ec68-4348-996a-d5f2bcec3243 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:05.263641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:05.394558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133216-a07c-46a4-86f0-acb4781bf5fb None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.395376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133216-a07c-46a4-86f0-acb4781bf5fb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.395853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90133216-a07c-46a4-86f0-acb4781bf5fb None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.400623 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 225/458] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:05.401749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89888a38-ec68-4348-996a-d5f2bcec3243 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:05.407150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef513-6e7d-496f-a6c9-4cdb8fb9369f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.407150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef513-6e7d-496f-a6c9-4cdb8fb9369f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.407150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eef513-6e7d-496f-a6c9-4cdb8fb9369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.453414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:05.455596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.456091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.457248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.472996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:05.474701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:05.481574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d7eef513-6e7d-496f-a6c9-4cdb8fb9369f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:05.483283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d7eef513-6e7d-496f-a6c9-4cdb8fb9369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:05.493550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:05.494643 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:05.495673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:05.495673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:05.495673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:05.495673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:05.498286 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 234/459] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:05.504952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:05.670908 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 226/460] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:05.687773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ce0e-3758-4489-94ac-77d3bafc7b94 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.689202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ce0e-3758-4489-94ac-77d3bafc7b94 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.689647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9ce0e-3758-4489-94ac-77d3bafc7b94 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.691175 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 227/461] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:05.695673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:05.700117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152c36-fabe-4971-b05a-606b69038999 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.700536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152c36-fabe-4971-b05a-606b69038999 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.700830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152c36-fabe-4971-b05a-606b69038999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.730226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-16152c36-fabe-4971-b05a-606b69038999 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:05.733170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16152c36-fabe-4971-b05a-606b69038999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:05.735023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee92f0-c06a-4e7c-9b68-719844907b6f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:05.785423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:05.786476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:05.787205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:05.787688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:05.788698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:05.789212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:05.790800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:05.806728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:05.821188 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 235/462] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:05.822875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:05.850451 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 228/463] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:05.851344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152c36-fabe-4971-b05a-606b69038999 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:05.972784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6317ff-100e-4fa4-8f1b-6398fa3da5c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:05.983506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152c36-fabe-4971-b05a-606b69038999 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.011576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.014012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.014378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.014674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.016851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.024762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.025381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.025664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.025938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.026615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.028752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb04dce-3625-4fdf-a42f-49fe1e014af6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.029757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.031211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:06.047722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:06.049257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 236/464] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:06.050095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.057274 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 229/465] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:05 2022] POST /identity/v3/users => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:06.058508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a445-a6d0-4345-9743-760d2ef5dc83 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.059336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a445-a6d0-4345-9743-760d2ef5dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.059667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2a445-a6d0-4345-9743-760d2ef5dc83 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.065644 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 230/466] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:06.065644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a445-a6d0-4345-9743-760d2ef5dc83 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.114766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.192616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0016b4-338f-43ef-a454-d9b205ab3e4c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.197839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2a445-a6d0-4345-9743-760d2ef5dc83 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.238757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.239508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.239615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.239821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.251091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.252049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.252539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.252962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.253365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.253970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:06.254424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.254819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.256180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e5eb62f8-a510-4700-806f-33a5f66e8c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:06.272790 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:06.273901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 237/467] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.274905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.275278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.280667 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 231/468] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:06.283179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.301381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:06.302592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:06.342875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.386511 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 238/469] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:06.388247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.396331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.403343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a425f-3871-4e9e-b8f5-3f12801fdb5c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.444657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.445591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.445958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.446334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.447153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:06.447565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.449239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.467664 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 232/470] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:06.469072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.537320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f3b60-42dc-4161-b1b3-8ce9d1b912d9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.576238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.577166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.577680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.578157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.579035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.579210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340729b-bd2b-491e-8029-8966fd978e29 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.581043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.609431 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 239/471] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:06 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:06.611297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.619370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.620328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.620688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.621056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.636128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.638226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.648854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:06.658403 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:06.659282 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:06.660696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:06.660696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:06.660696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:06.660696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:06.660696 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 233/472] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:06.665271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.677285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:06.767578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dc6f9-194a-4319-a1e4-2875406d3864 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.791492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c3c2a-016f-4142-9cae-fb6d7108e714 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:06.816999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.818280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.819189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.819976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.820916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.823624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.831657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:06.832341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.832630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.832977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.833700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:06.834325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:06.835833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3ba0-4e4b-47ed-9c4c-2b11a272463b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:06.854697 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 234/473] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:06.857274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc30e8-c27f-4778-acb9-989d726b7c38 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.857805 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 240/474] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:06 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:06.858305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc30e8-c27f-4778-acb9-989d726b7c38 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.858872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc30e8-c27f-4778-acb9-989d726b7c38 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.860916 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 235/475] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:06.861999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:06.869929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:06.869929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:06.869929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:06.895620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:06.897188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:06.992471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.005281 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 236/476] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:07.018728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.030761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:07.046467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce844a-4e33-4229-8020-5caf4d4c4ea8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:07.097348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:07.098088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.098268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.098545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.099682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:07.101475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:07.126791 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 241/477] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:06 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:07.151361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48cd0-3007-4b19-8da7-21692baacf0c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:07.190238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:07.191005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.191292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.191564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.192297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:07.193677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:07.201357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.sql.core [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:05:07.201357 dv-cinder-master-3-smb devstack@keystone.service[80453]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:05:07.201357 dv-cinder-master-3-smb devstack@keystone.service[80453]: [parameters: {'id': 'bf4da9de0cfd4173b9a63cc7eed6615a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:05:07.201357 dv-cinder-master-3-smb devstack@keystone.service[80453]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80453) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result.read() Jul 31 01:05:07.218632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return ref.to_dict() Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:05:07.219557 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application yield resource Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise self.value Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application session.commit() Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:05:07.220523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:05:07.221369 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:05:07.222231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result.read() Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:05:07.224988 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [parameters: {'id': 'bf4da9de0cfd4173b9a63cc7eed6615a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:07.226051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 31 01:05:07.228037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:07.232070 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 237/478] 10.222.0.47 () {60 vars in 1131 bytes} [Sun Jul 31 01:05:07 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:07.232218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:07.367678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a76e7a-c214-454d-bc24-6af2d18385a8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:07.405751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:07.406671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.407114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.407535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.410563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.421767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-cee9055a-72bc-418d-bcf3-fcb40df03530 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:07.435989 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:07.437158 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 31 01:05:07.438148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:07.451329 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 242/479] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:07.456817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:07.523585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:07.569465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b316f-9165-4eae-9117-ded03bde74df None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:07.606443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:07.607114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:07.607392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:07.607711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:07.608464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:07.608823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:07.610204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3ff3b-7749-4006-8aac-43fd88418176 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:07.619888 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 238/480] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:08.582752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1d1-425b-458c-b009-9fa643cc0086 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:08.583771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1d1-425b-458c-b009-9fa643cc0086 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:08.584579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087d1d1-425b-458c-b009-9fa643cc0086 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:08.586130 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 243/481] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:08.591835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:08.592684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:08.593167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:08.620966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:08.623391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:08.708428 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 239/482] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:08.743325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d1d1-425b-458c-b009-9fa643cc0086 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:08.868834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087d1d1-425b-458c-b009-9fa643cc0086 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:08.911661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:08.912337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:08.912619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:08.912894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:08.925956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:08.931285 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:08.932169 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:08.933033 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 244/483] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:08.938878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:08.992230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.055955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3d0c-135a-47cc-8835-6f54e2e4ab3a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.092622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.093237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.093516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.093792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.094505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:09.094805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:09.096207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:09.104464 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 240/484] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:09.111035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.166796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.218686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82e002-5405-4593-9dbe-0c89994d14fd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.265728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.266279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.266559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.266830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.280778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:09.282231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e98a29a5-2415-4765-9c18-955656053db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:09.299923 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:09.300807 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:09.301621 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:09.301621 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:09.301621 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:09.301621 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:09.301621 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 245/485] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:09.306916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.414187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188565-f3a4-4ad4-8c81-bd5dc1f1c77b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.414508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188565-f3a4-4ad4-8c81-bd5dc1f1c77b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.414731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01188565-f3a4-4ad4-8c81-bd5dc1f1c77b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.416256 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 246/486] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:09.429294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7a64-2781-4596-803e-cb4a1659812c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.429596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7a64-2781-4596-803e-cb4a1659812c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.429852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7a64-2781-4596-803e-cb4a1659812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.439429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1fbc2-8010-43f3-ab87-fd35203cbe0d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.456386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.466687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ab3b7a64-2781-4596-803e-cb4a1659812c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:09.467954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ab3b7a64-2781-4596-803e-cb4a1659812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:09.493379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.494024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.494310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.494592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.495300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:09.495612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:09.497995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5eba3-733e-49e9-a433-c110e302552f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:09.516700 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 241/487] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:09.521743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eee89-8ec2-495b-93fe-c8652f6c468a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.521743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eee89-8ec2-495b-93fe-c8652f6c468a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.521743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179eee89-8ec2-495b-93fe-c8652f6c468a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.521743 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 242/488] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:09.525179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eee89-8ec2-495b-93fe-c8652f6c468a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.558704 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 247/489] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:09.561230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.561524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.561806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.581555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:09.582997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:09.617721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.659290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179eee89-8ec2-495b-93fe-c8652f6c468a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.663528 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 248/490] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:09.664578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.718828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.719478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.719765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.720065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.728095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:09.729548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:09.744391 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:09.745356 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:09.746946 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:09.750833 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 243/491] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:09.751862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.777850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c301cc0-dcc1-4492-9b38-9503aaa99a41 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.796180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.816875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.817792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.818213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.818670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.832292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:09.837613 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:09.838577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:09.839349 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:09.841768 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 249/492] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:09.842733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.878518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:09.890675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c790f9-36d2-4847-9b3f-16b8d20b7c63 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:09.932060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:09.932709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:09.932996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:09.933281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:09.945380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:09.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:09.952608 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:09.953384 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 244/493] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:09.954029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:09.965165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efd4c1-995f-4206-ba31-8b75fe48699a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.001891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.002505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.002793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.003075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.003875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.004209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.005649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd88925-9838-42ab-9455-7525e0f3ebcc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.044155 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 250/494] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.050349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077e77-f4ac-4b2b-b487-c1d26d2c9a1d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.050637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077e77-f4ac-4b2b-b487-c1d26d2c9a1d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.050912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077e77-f4ac-4b2b-b487-c1d26d2c9a1d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.052370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 251/495] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:10.054059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.056785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077e77-f4ac-4b2b-b487-c1d26d2c9a1d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.063647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863594c-997f-4a57-b128-33edd645dc93 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.100940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.101595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.101885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.102166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.102885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.103196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.104633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.118220 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 245/496] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.118220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.153276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.170332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077e77-f4ac-4b2b-b487-c1d26d2c9a1d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.204547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.205162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.205444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.205717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.206423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.206724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.208122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a55aaf-f0c5-4706-9515-278dc448ed6d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.217114 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 252/497] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.218126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.218412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.218688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.232929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f7b56-7c0b-4557-9b45-bcc8617aca65 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.237155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:10.238342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:10.270341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.270963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.271250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.271530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.302063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.309259 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 253/498] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:10.310335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.351401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.352932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.397700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.423058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7eba-25e9-4a54-b241-53800b0164d8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.457806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 246/499] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:10.458485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.474296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.474936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.475223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.475506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.486435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.487914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:10.503352 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:10.504263 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 254/500] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:10.509650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.524307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.569394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad065d-217f-4fcb-bb7e-c9240c0fdba8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.606865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.607504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.607789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.608117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.618168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.619626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.622597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c50a-f4a3-43b0-ae5d-02c126973935 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:10.634035 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:10.635037 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:10.635886 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:10.635886 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:10.635886 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.635886 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:10.635886 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 247/501] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:10.636402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.651207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.658710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.659443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.659723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.660034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.671166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:10.676471 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:10.677366 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 255/502] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:10.678380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.739653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83371a-ee94-4679-bd6b-30fb4102172e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.749233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.775511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.776171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.776453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.776732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.776985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b933d3-b03c-4796-87a0-df3f3c798dff None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.787188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.788661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a88d029b-79df-405d-813d-e88b3847d5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:10.803212 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:10.804164 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:10.805003 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:10.805003 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:10.805003 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:10.805003 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:10.805003 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 248/503] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:10.805841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05394-179f-462a-87d5-7a69b610458e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.806128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05394-179f-462a-87d5-7a69b610458e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.806402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c05394-179f-462a-87d5-7a69b610458e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.807690 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 249/504] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:10.808401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05394-179f-462a-87d5-7a69b610458e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.816873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.817497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.817778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.818056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.818753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.819059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.820516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.832637 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 256/505] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.833421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.883716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.913649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c05394-179f-462a-87d5-7a69b610458e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.934336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36a166-65fd-4aff-8454-b8ce010db67d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:10.947205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.947814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.948119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.948392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.949076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.949645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.951073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.962955 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 250/506] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.963646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:10.972549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:10.973153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.973433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.974057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:10.974771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:10.975388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:10.976783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bac35c-7a7d-45c6-8638-ab8d6057097e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:10.984674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:10.989776 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 257/507] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:10.989776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:10.989776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:10.989776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.005149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:11.006400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:11.069967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc4dc2-f57c-4f75-9a81-08c10206bf33 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.072128 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 258/508] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:11.072803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.107191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.107805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.108114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.108383 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.109073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.109376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.110746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.122221 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 251/509] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.122709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.123292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.182285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c1fb4-2869-4ce3-b94d-93512c384ec5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.203725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.216862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.217498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.217774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.218051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.222642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4480ef-43e3-4d70-b4c1-604046dbd9f5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.225100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.226576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:11.240152 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:11.241085 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:11.241986 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 259/510] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:11.242535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.257509 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.258147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.258431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.258706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.266848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.268324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:11.279387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:11.280349 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:11.281227 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 252/511] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:11.281790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.345108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0185-3ed3-48af-a1d2-ea824e83ce31 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.346523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.379401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.380062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.380344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.380621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.383924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe6b75-8e60-4192-964c-2cb1463663a4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.391395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.392892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:11.407819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:11.408890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:11.409751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:11.409751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:11.409751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:11.409751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:11.409751 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 260/512] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:11.410017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.419738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.420433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.420714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.420985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.431774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.434746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.436855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:11.453727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:11.454758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:11.455792 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:11.455792 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:11.455792 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:11.455792 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:11.456198 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 253/513] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:11.456884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.512639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbed16e-e4c3-4c96-b2ba-4bcacf970b42 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.546103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.546731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.547009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.547283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.553794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.555228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.556958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c719a09-c6bf-4162-b424-80bb1a57afd7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:11.567566 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:11.568624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:11.569506 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 261/514] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:11.569969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.585544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.595560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.596155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.596444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.596723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.597524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.597833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.599266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.637120 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 254/515] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.637944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.669056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae639b4-2359-47c4-bb20-9ae6c5337d52 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.690292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.702483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.703095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.703379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.703647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.704453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.704758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.706295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.723361 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 262/516] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.724183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.745235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cc11b-1a6d-4769-8229-967c9d5b19ec None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.780796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.781406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.781697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.781968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.782653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.782959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.784363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.794407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.795738 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 255/517] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.796538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.825425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8988-f2ec-4e03-917e-e534f28f9a92 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.867195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.867746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.868058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.868345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.869032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.869339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.870726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.883214 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 263/518] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.884059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.904145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930e72b-9e47-400b-85cf-01df131a2a31 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:11.914586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:11.938414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:11.939019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:11.939299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:11.939571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:11.940344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:11.940649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:11.942076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:11.959777 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 256/519] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:11.960646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:11.988743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17ba66-91ae-4f06-afd0-32d2f1d6abc4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.017496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.023091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.023784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.024156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.024438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.061544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2cac8-ea1d-403b-99fb-9616fb7c7f44 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.092579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.094044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.095636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.096284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.096566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.096847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.135536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.165081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.166561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.191639 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 264/520] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:12.192522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.223014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.263945 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 257/521] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:12.268522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.293134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411114e2-eba2-4bd6-a8fb-2bbe2cf21fad None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.326736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.327368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.327646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.327925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.330943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.335081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.336547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:12.348826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:12.349835 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 265/522] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:12.350708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.363467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3262-f983-4cb7-878c-7141ee144c3a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.396367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.396914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.397196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.397474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.398147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.399590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.422168 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 258/523] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:12 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:12.423205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.448324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.463571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad928b1-2d9d-412b-8160-ad5099d84ab7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.503742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.504475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.504762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.505038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.505891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:12.506204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.507673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.520464 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 266/524] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:12.522292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.553568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0723d4-b25a-4a2c-a0c0-a8ccbf435e4a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.591708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.604254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.606874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.607755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.608134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.623342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.626140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:12.647523 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:12.648563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:12.649624 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:12.649624 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:12.649624 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:12.649624 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:12.651193 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 259/525] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:12.653304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.677791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebefd7-2710-4294-9aaa-60ce522f9707 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.717403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.718308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.718730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.719144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.732295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.733992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:12.756724 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:12.757722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:12.758708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:12.758708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:12.758708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:12.758708 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:12.758708 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 267/526] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:12.759720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.779879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.803631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf69da-bf04-45a8-9f7c-dea01cc9d1f7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.841764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.842766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.843262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.843728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.844750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:12.845273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.846948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.870948 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 260/527] 10.222.0.47 () {56 vars in 1139 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:12.872874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.896592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac774b-42ae-4a25-a0c5-b4cd5822f138 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:12.913659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:12.945309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:12.945933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:12.946225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:12.946504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:12.947466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:12.947774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:12.950891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:12.967918 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 268/528] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:12.968796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:12.987336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a8f50-6d30-4c98-97d5-a4ad766ad593 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.030019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.031096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.031510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.032134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.033323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:13.033730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.035257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.051757 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 261/529] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:13.052918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.057381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.107805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ded49d-adab-41f5-96f8-26c3e0992941 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.151299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.151966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.152300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.152692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.174392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.183666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92e75a-f18c-4790-91fa-305e683003bb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.232364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.233662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.234562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.235307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.241700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.243454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.244506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.248028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:13.263513 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:13.264413 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:13.265236 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:13.272068 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 262/530] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:13.273050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.331782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.371448 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 269/531] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:13.372667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.395297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5421b-b92b-45d2-9ccf-5d39e2b6d93a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.435678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3850a-7405-4998-9517-18985364361a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.436517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3850a-7405-4998-9517-18985364361a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.436861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3850a-7405-4998-9517-18985364361a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.437224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3850a-7405-4998-9517-18985364361a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.450916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3850a-7405-4998-9517-18985364361a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.452637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3850a-7405-4998-9517-18985364361a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d2d3850a-7405-4998-9517-18985364361a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:13.467057 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:13.468127 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:13.469151 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:13.470738 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 263/532] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:13.476122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3850a-7405-4998-9517-18985364361a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.484834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6a785-803f-42e9-945d-53ed49aaaf88 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.496488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.524876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.525822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.526243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.526658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.528512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:13.529057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.530804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.554881 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 270/533] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:13.555983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.588537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.589766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3850a-7405-4998-9517-18985364361a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.629824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.630923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.631161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.631554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.644227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.645854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:13.664074 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:13.665174 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:13.666022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:13.666022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:13.666022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:13.666022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:13.666809 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 264/534] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:13.667865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.673967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687aa94-190b-4cce-90e2-ff1b11810b06 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.712354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.713647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.714128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.714542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.715477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:13.716148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.717849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.732306 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 271/535] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:13.733476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.752859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.798945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b851a3-bda3-4b7b-b0e0-66b548b6d75e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.841441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.842976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.843398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.843997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.845211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=8d1d0d00aea849cb97808332cb98cfbf) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:13.845684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.847249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.848137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:13.855080 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 265/536] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/role_assignments?user.id=8d1d0d00aea849cb97808332cb98cfbf&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:13.860960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:13.881213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9994b5e-21c7-4afe-9ef2-19035b4551e4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:13.935259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:13.935954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:13.936258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:13.936540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:13.937912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:13.938552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:13.940068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:13.955483 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 272/537] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:13.963692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:14.073243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f67ec-d6fc-493b-850a-a818ad5712f4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:14.107322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:14.113667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:14.114723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.115224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.115702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.116823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=ce143d790f1745f2b66494b85f1fb66e) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:14.117362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:14.119064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:14.125760 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 266/538] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/role_assignments?user.id=ce143d790f1745f2b66494b85f1fb66e&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:14.164229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd8fe3-5fe6-410e-bcdb-dad486630bdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:14.204607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:14.205271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.205554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.205826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.214015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:14.216373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:14.229675 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:14.231182 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:14.232288 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 273/539] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:14.237519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:14.364794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944d95b-2df1-4b7b-97cc-5a38ab8d7b4e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:14.403078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:14.404374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.404857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.405404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.406353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:14.406873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:14.408581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bebbbd-a745-489b-bb37-3ebac267b197 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:14.422725 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 267/540] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:14.428914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:14.444644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:14.545477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656fb30-cce9-4b6b-8d05-4ce82a45ab6d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:14.581602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:14.582562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.583043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.583514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.584843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=5ba914491e3643158d83fd51fbfc6263) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:14.585354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:14.587007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dc232-dd93-407c-b639-fb24cd401828 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:14.594649 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 274/541] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:14 2022] GET /identity/v3/role_assignments?user.id=5ba914491e3643158d83fd51fbfc6263&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:14.698129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd405f3-061c-4569-9ed9-5cf30e7f46bf None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.698838 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd405f3-061c-4569-9ed9-5cf30e7f46bf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.699872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd405f3-061c-4569-9ed9-5cf30e7f46bf None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.702365 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 268/542] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:14.704922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ae894-55d5-47a1-980d-21a2d4adbd95 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.705218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ae894-55d5-47a1-980d-21a2d4adbd95 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.705501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ae894-55d5-47a1-980d-21a2d4adbd95 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.707501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.707783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.708094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.713364 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 275/543] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:14.720633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:14.720947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:14.721196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:14.742894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:14.744161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:14.763439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:14.764860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:14.841114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:14.876266 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 276/544] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:14.876567 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 269/545] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:14.899252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:14.901680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:14.921352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.083736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df55ea-c6a3-4cc3-bc5a-842c2bc7177e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.094213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33cbdc-3851-40bd-bb09-95feea50e78f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.125456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.126107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.126388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.126663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.138367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:15.143795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:15.144696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:15.145476 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:15.146061 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 270/546] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:15.153993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.176389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.177035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.177312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.177580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.199878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:15.204743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:15.205610 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:15.206381 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 277/547] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:15.216927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.235988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:15.295698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c84ef-4baa-4b9c-bbdc-424eb3ca0c78 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.331470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.332468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.332978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.333463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.334689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:15.335190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:15.336903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:15.345948 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 271/548] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:15.352313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.368314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:15.454682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e267-abda-47d9-bb35-00278d96b1e1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.526786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.527848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.528356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.528828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.529835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:15.530345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:15.531914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:15.541785 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 278/549] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:15.550082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.557715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eba0f-6d99-4e0e-b2f2-f0c15aeb4925 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.580278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:15.631948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.632533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.632812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.633083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.647686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:15.658569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:15.682324 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:15.683799 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:15.685025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:15.685025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:15.685025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:15.685025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:15.688187 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 272/550] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:15.689607 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.777763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff69b0-daf9-4c61-86b4-df39328697f5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.824924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:15.828124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.828983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.829264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.829871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.843768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:15.845276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:15.862753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:15.863661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:15.864540 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:15.864540 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:15.864540 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:15.864540 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:15.865335 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 279/551] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:15.870957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:15.904184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d654-bbd3-45d1-9f80-efa1c2146ed5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:15.974785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:15.975416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:15.975699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:15.975997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:15.976701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:15.977006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:15.978382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.002146 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 273/552] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:16.009491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.051913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.065761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274b4d-a6dc-45c0-831b-6008992db59f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.135111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.136463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.137276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.137736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.138627 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:16.138939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.140338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.171746 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 280/553] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:16.178343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.199019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7dc5a-35aa-4092-bc01-dfa4a20152e9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.216506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.245041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.245841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.246757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.247199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.256357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.258553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2a2fcc1c-64f1-46b3-b9be-b77aa0c7c3b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:16.274273 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:16.276400 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:16.279021 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 274/554] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:16.280377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b616-b1f9-4c37-9db6-46cb53a4618d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.280377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b616-b1f9-4c37-9db6-46cb53a4618d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.280377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0b616-b1f9-4c37-9db6-46cb53a4618d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.286341 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 275/555] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:16.286571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b616-b1f9-4c37-9db6-46cb53a4618d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.295887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490eb8b-dda5-4c9c-8749-d581f6fc76cb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.335620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.336361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.336752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.337121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.345967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.347592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3a834181-f906-4267-9059-9ab0d00d9956 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:16.361192 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:16.363334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 281/556] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.366064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.367679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.380926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.386037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:16.388438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:16.403445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0b616-b1f9-4c37-9db6-46cb53a4618d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.438934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.439483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.439770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.440082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.441302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:16.441302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.442644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.462074 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 276/557] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:16.462985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.474604 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 282/558] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:16.475856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.506568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.602490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74b4c-5358-4fea-ac64-58424e67b676 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.604326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6be9f-0de6-4e02-9c45-424904df12ae None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.641507 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.642144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.642427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.642703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.643744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:16.644083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.646192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.649471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.650263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.650784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.651203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.655897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.670221 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 277/559] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:16.671511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.735825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:16.737605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac1669-99ac-4423-aa4c-937138602131 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:16.773197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.789015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5c10-4fab-4201-899d-3db731e5e2bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.826955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.827899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.828273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.828521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.840614 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:16.845524 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:16.846547 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:16.847358 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 278/560] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:16.848070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.858132 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 283/561] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:16.859421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4d7ab-7ccc-40e0-b06f-b3fb9ee93188 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.859713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4d7ab-7ccc-40e0-b06f-b3fb9ee93188 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.860123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4d7ab-7ccc-40e0-b06f-b3fb9ee93188 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:16.861380 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 284/562] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:16.865872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4d7ab-7ccc-40e0-b06f-b3fb9ee93188 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:16.915788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.960902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73354992-7690-48d8-87b1-99ff93567d1b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.969369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4d7ab-7ccc-40e0-b06f-b3fb9ee93188 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:16.995252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:16.995412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:16.995812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:16.996818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:16.997076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.005433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.006195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.006487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.006797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.007351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.007496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:17.007802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.008855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.009216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.018210 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 285/563] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:17.018991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b23f44d1-ce20-442d-ab99-32c867f18756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:17.023957 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.024855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.025750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:17.025750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:17.025750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.025750 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:17.025750 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 279/564] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.026504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a59ba-ca2b-49b2-9849-1c114ea3f89a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.026504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a59ba-ca2b-49b2-9849-1c114ea3f89a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.026773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a59ba-ca2b-49b2-9849-1c114ea3f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.045803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-131a59ba-ca2b-49b2-9849-1c114ea3f89a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:17.046991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-131a59ba-ca2b-49b2-9849-1c114ea3f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:17.115489 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 280/565] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:17.116947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3a913-6a5b-46fe-ba82-9540c6733abd None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.117281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3a913-6a5b-46fe-ba82-9540c6733abd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.117623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3a913-6a5b-46fe-ba82-9540c6733abd None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.118939 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 281/566] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:17.119701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3a913-6a5b-46fe-ba82-9540c6733abd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.134457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ecf-96af-47ed-83d8-2a47fd211a37 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.171109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.171305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.171750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.172079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.172358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.183041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.184848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:17.198998 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.200120 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 286/567] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.206183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.235355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3a913-6a5b-46fe-ba82-9540c6733abd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.244159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.282899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.283831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.284333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.284789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.296271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.297715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9125c5a9-a326-40f0-a052-a569aebfb423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:17.313231 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.314258 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.315373 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:17.315373 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:17.315373 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:17.315373 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:17.315373 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 282/568] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.315714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.315862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.316225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.321463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4214-afe8-4fe1-ad28-9629425e0f10 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.334483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:17.335672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:17.355948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.356573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.356859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.357140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.357834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:17.358192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.359559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.371600 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 287/569] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:17.376085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.403458 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 283/570] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:17.404410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.424893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.486412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.489344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d89a4-eb16-4903-8356-5a99d3f7b609 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.512193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb94e0-0838-4a14-81d2-26a1883a14f5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.523314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.523963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.524252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.524521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.536210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:17.540941 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.542020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 288/571] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.543535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.549256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.549879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.550162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.550437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.551136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:17.551442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.552857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.565216 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 284/572] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:17.566015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.642711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77ca4f-6c2d-40dd-b158-3bb29b9badc9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.648758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.668722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa325d75-0498-4c55-8077-49de00db09c2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.677852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.678472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.678762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.679038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.679726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:17.680066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.681426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.693658 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 289/573] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:17.694446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.702900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.703554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.703833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.704139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.711189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.712674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.717834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:17.725052 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.725935 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:17.726814 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 285/574] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.727810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.801023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dd5b4-58a9-421e-b615-ed904c05a107 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.826115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759a40-dd1f-441d-b650-40703fbb2a17 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.834978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.835610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.835889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.836189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.847359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:17.853403 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:17.854373 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:17.855214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:17.859999 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 290/575] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:17.860673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.861168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.861786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.862072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.862348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:17.863228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:17.863544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:17.864949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:17.873171 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 286/576] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:17.873898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:17.876666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.943209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:17.963961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99157-3661-410b-93e3-c48ef0ff01ef None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.983790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a15ee9-c0ad-4712-88b6-61bdb5148790 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:17.998590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:17.999237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:17.999523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:17.999802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.006499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.007970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.016330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.016962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.017248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.017523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:18.019148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:18.020024 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 291/577] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:18.021154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.029478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.030909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:18.042276 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:18.044318 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:18.045297 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:18.046298 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 287/578] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:18.047302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.107079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.124676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9678-3752-47cc-93e8-7f62d2c44283 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.146212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294fc6b-8075-4245-8fae-6ec573f3c602 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.157845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.158567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.158920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.159264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.160123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.160432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.161856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.170952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.179096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.179834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.179974 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 292/579] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.180067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.180285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.180584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.180996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.181303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.182658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.191564 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 288/580] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.192408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.281454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a9c6-5ec0-4d5b-a348-beee7dc51d51 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.291647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cb604-0f79-45a4-8efb-6bde99c28278 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.315566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.316199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.316314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.316503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.316779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.327133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.327344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.327978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.328269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.328543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.328664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.329287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.329594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.331022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:18.343264 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:18.344309 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:18.345181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:18.345181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:18.345181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.345181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:18.345405 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 289/581] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.345473 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 293/582] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:18.345473 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.345591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.399459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.447949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c262e7-09d9-4981-b067-af40ee4d28c0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.449043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8b3e-0dd8-4165-a4eb-890af1826ddf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.484245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.484561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.484910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.485173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.485264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.485458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.485556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.485735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.486523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.486830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.488300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.500810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=6f8bf5d3a0014e24af8195f4cdb1bf66, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.502246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.505408 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 290/583] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.506218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.515597 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 294/584] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:18 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:18.516440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.558061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.625837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6606162-b6e3-4478-9d3f-72cb83ee5e0b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.648928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de478f4-788b-4a72-b3fe-cecfd51494ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.651095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.671758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.672454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.672749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.673150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.686199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.687697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.695686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.696342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.696991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.697283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.698081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4d58f02ebba84bf0b29ef054b7d8cc8f) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.698391 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.700519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:18.704211 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:18.705070 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 291/585] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:18.706533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.720134 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 295/586] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/role_assignments?user.id=4d58f02ebba84bf0b29ef054b7d8cc8f&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.720134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.825797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:18.834684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df0f527-a263-4922-9fe0-0940a38230f4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.870821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4f6a1-5290-487d-b588-8eabd80b60c8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:18.885569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.885764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.886010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.886206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.886984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:18.887423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.889427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.904750 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 292/587] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:18.905381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.913979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:18.914930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:18.915435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:18.915914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:18.928943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:18.930793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:18.947281 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:18.948228 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:18.949761 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:18.949761 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:18.949761 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:18.949761 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:18.952318 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 296/588] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:18.953520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:18.976494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.021559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e72d63-45bd-49a6-877a-addfa24095bf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.060709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.061341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.061630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.061911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.062613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:19.062923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.065663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.079170 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 293/589] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:19.080243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.090107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0f319-ee30-4fbc-ac91-1f54fc8e7c0b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.098827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.129522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.130427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.130960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.131389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.140140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.141889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:19.155014 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:19.156159 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:19.157179 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:19.159459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 297/590] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:19.160424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.193042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b3d99-8e7c-4079-a735-cd8ffaf6ce37 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.232095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.233179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.233179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.233369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.234063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:19.234378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.235769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.247050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.254682 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 294/591] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:19.255948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.271359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e873-3dc4-494d-a83c-2220df4e21f0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.307541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.308218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.309414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.309737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.317932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.319334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:19.330841 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:19.332035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:19.333123 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 298/592] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:19.333743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.340515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.366949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e2ab-fea2-439d-85eb-3b4da9c2aee7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.406276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.407392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.407833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.409142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.410160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:19.410618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.412324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.443164 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 295/593] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:19.443164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.451002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0eb3d-9878-439c-a0a5-2fa920e49f91 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.495830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.497827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.498296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.498722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.508393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.510783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.513620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:19.527608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:19.528749 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:19.529862 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:19.537163 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 299/594] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:19.537163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.563777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165518f-651c-4fc0-9c7d-32359bf7fbc1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.607576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.616542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.618223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.618699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.619124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.620130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:19.620647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.623088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.651132 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 296/595] 10.222.0.47 () {56 vars in 1139 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:19.652895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc8997-ac14-45e6-a591-69c82a37ab02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.653106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.694117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.694800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.695184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.695577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.710779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.712602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:19.734930 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:19.736077 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:19.737153 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:19.737153 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:19.737153 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:19.737153 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:19.738939 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 300/596] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:19.739949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.778879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a461a5-ab1c-4f7b-9d39-65db9e31380e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.811507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.816287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.817158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.817650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.818131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.819108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:19.819621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.821351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.842341 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 297/597] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:19.843676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.876087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795869e-52b7-49e1-93dd-2075a1893c4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:19.912656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:19.916627 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547beba3-e199-4490-b262-63f905da0bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:19.917525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547beba3-e199-4490-b262-63f905da0bee None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:19.918944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547beba3-e199-4490-b262-63f905da0bee None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:19.919477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547beba3-e199-4490-b262-63f905da0bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:19.934747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547beba3-e199-4490-b262-63f905da0bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:19.937115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547beba3-e199-4490-b262-63f905da0bee None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-547beba3-e199-4490-b262-63f905da0bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:19.954517 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:19.955417 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:19.956320 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:19.956320 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:19.956320 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:19.956320 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:19.956320 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 301/598] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:19.957224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547beba3-e199-4490-b262-63f905da0bee None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:19.982976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1dc0f-cd12-4d1c-98d6-8d8f18611b17 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.022049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.023528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.024132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.024703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.025693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:20.026198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.028954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.042572 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 298/599] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:20.044429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.065741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547beba3-e199-4490-b262-63f905da0bee None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.067279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.103412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.104119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.104406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.104692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/8d1d0d00aea849cb97808332cb98cfbf/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.122413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=8d1d0d00aea849cb97808332cb98cfbf, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.124020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.147959 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 302/600] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:19 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/8d1d0d00aea849cb97808332cb98cfbf/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:20.147959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.183046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a62e8-8f8c-4af8-b58f-df33fa44aa92 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.212398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.269578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea000e9-7a32-4d42-8f09-4c55e20e3961 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.290652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.291295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.291582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.291861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.292599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:20.292947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.294411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.309368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.310173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.310575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.310863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.314821 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 299/601] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:20.316286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.336809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.338284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:20.354174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:20.355090 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:20.356519 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 303/602] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:20.362642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.381907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.451379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1baff-81c2-4a07-87a7-2ef85a9f9074 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.490555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.491448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.491875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.492326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.499028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b676-5016-4493-9544-4fe54a9134a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.501749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.503266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:20.515984 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:20.517068 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:20.518169 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 300/603] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:20.522231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.567868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.570079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.570462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.571570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.572484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:20.573553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.576398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.577549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.601189 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 304/604] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:20.607395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.694304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083af7-2aff-46c8-85bb-7b437ced139f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.720341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.735843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.736888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.737381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.737962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.739029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:20.739556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.741325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.757063 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 301/605] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:20.759972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071137d0-35c8-4602-99c0-d2610f66adfe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.764577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:20.803329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:20.806680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.806680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.806680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/ce143d790f1745f2b66494b85f1fb66e/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.822905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=ce143d790f1745f2b66494b85f1fb66e, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:20.825008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e71c-5f9c-4d60-940f-413fcc141f68 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:20.846086 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 305/606] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:20 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/ce143d790f1745f2b66494b85f1fb66e/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:05:20.847330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6dfe-ce81-4118-b874-6cb550ce6eb5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.847614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6dfe-ce81-4118-b874-6cb550ce6eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.847892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6dfe-ce81-4118-b874-6cb550ce6eb5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.853355 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 306/607] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:20.856298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e99d05-5aea-4853-be9d-c18976382e7a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.857550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e99d05-5aea-4853-be9d-c18976382e7a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.858132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e99d05-5aea-4853-be9d-c18976382e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.882824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-13e99d05-5aea-4853-be9d-c18976382e7a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:20.885827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-13e99d05-5aea-4853-be9d-c18976382e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:20.959572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:20.975091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029c2ad-9128-4ead-ab08-d48424f82e2d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:20.978291 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 307/608] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:20.979970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c889e-cc30-4292-b7eb-42e2550087b5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.981080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c889e-cc30-4292-b7eb-42e2550087b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.981605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c889e-cc30-4292-b7eb-42e2550087b5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:20.983533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 308/609] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:20.996815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:20.997511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:20.997985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.022992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:21.024208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:21.032322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.032984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.033268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.033543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/5ba914491e3643158d83fd51fbfc6263/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.053953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=5ba914491e3643158d83fd51fbfc6263, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.056379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.075057 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 302/610] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:20 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/5ba914491e3643158d83fd51fbfc6263/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:05:21.076339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.082786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.111386 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 309/611] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:21.135096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.205469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f50fd3-3971-4d6f-9606-a8b31b264a06 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.245138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.246659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.247098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.247423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.255912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.259474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:21.266577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60255f2-bd46-4430-b5e4-c686f295221a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:21.267564 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:21.268621 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:21.269682 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:21.272498 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 303/612] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:21.278327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.304746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.305388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.305670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.305944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.318349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:21.323361 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:21.324507 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:21.325586 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 310/613] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:21.330896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.396534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3f463-8353-4952-b762-e6df80b93c65 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.401999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.435385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.436209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.436598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.436971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.437792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:21.438205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.439698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.449498 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 304/614] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:21.456213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.524823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a64cf-5a04-4a35-908f-59aafd2a14cc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.569152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.569929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.570315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.570692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.571533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:21.571959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.575067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.584128 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 311/615] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:21.589553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.595777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.669661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a035-047e-489d-8e11-9532c512ef76 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.706195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.706992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.707397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.707959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.726229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.728018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:21.750609 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:21.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:21.752514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:21.752514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:21.752514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:21.752514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:21.756076 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 305/616] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:21.757270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.788463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22b017-9955-49c1-8315-5544f656159a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.798932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:21.856733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:21.857423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:21.857703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:21.857976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:21.868726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:21.870334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:21.885920 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:21.887332 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:21.888458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:21.888458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:21.888458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:21.888458 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:21.888458 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 312/617] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:21.893541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:21.934178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4b2-0f12-4a6e-8438-b7e765b7a3e2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:21.981725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.005565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3d9b5-1a90-4420-a720-2000d6550695 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.024320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.026294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.026746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.028569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.029409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:22.029856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.033992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.054806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 306/618] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:22.062905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.067804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.068616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.069040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.069478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.070312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:22.070907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.073278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.099442 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 313/619] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:22.105657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.141709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.236958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c67c7-0c07-494e-9e35-c3d60faf0dc2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.266106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62981dc5-9c99-45e7-bec3-016f9b3656be None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.273591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.274501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.275003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.275477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.283406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.285144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:22.298599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:22.299673 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:22.300624 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:22.304148 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 314/620] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:22.315152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.341161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.341805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.342086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.342418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.356647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.358103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:22.377876 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:22.378821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:22.379744 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:22.383983 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 307/621] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:22.384712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.445427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.455253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.500098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a556e3-a82e-47ad-adfd-9dd3d8c5cfb2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.566379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.566923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.567205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.567479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.568308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:22.568618 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.570046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.573721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c2999-2b22-49c4-ac84-d44cc3045e83 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.615159 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 315/622] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:22.630106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.645877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.646511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.646794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.647070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.647873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:22.648208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.649648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.688883 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 308/623] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:22.690282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.786975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d77b1-d3b5-4449-80f5-ac0f795adeb7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.833256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.834072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.834716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.835095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.837272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.847423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:22.849051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9d5f8703-803a-4083-a8b9-9770267872fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:22.865042 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:22.866130 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:22.867214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:22.867214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:22.867214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:22.867214 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:22.872288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ae818-e8ac-4fee-b1b4-99a66a22a862 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:22.873127 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 316/624] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:22.874504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074ac6-82da-44ee-832a-626764392335 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.874905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074ac6-82da-44ee-832a-626764392335 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.875797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074ac6-82da-44ee-832a-626764392335 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.876744 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 317/625] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:22.882143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074ac6-82da-44ee-832a-626764392335 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:22.885412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:22.926290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:22.927288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:22.928278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:22.928762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:22.994860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb074ac6-82da-44ee-832a-626764392335 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.028878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.030906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44bd7d-2e1d-4bf3-b33b-f541bf2685b9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.032420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.033113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.033463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.033852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.034660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:23.035028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.036530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d24e-2db2-4da8-aadd-9b7219b88eac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.054833 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 318/626] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:23.056270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.056632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.057020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.078346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:23.079693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:23.126520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.147308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.162275 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 319/627] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:23.162275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.162557 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 309/628] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:23.162557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6eb23-3dc7-4e8c-8a3c-17c33de75308 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.162557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6eb23-3dc7-4e8c-8a3c-17c33de75308 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.162557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6eb23-3dc7-4e8c-8a3c-17c33de75308 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.162903 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 310/629] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:23.164713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6eb23-3dc7-4e8c-8a3c-17c33de75308 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.265731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a33da1-722c-4903-904e-70b3ca34d739 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.281050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6eb23-3dc7-4e8c-8a3c-17c33de75308 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.301292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.301935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.302216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.302489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.310177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.311631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.318110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.318793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.319079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.319355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b58cc21b-e3e9-4785-a467-ffe3d81c468b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:23.322752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:23.323617 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 320/630] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.330746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.331477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.335317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.337084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.346502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:23.347753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:23.352674 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:23.353726 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:23.354800 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:23.354800 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:23.354800 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:23.354800 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:23.360989 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 311/631] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:23.360989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.384533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.408465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.428692 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 321/632] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:23.429539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.484647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc68d6-d3b0-431e-9701-597091c6dea1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.522910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.524023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.524309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.524579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.535840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:23.536626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4efe82-9a2e-4ddf-be11-47ecd04effab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:23.541532 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:23.542619 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:23.544335 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:23.550911 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 312/633] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:23.551738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.573922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.574560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.574849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.575126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.575873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:23.576220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.577639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.589165 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 322/634] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:23.590012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.618810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.654212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1cc04-c780-4b67-83d4-f60f498f43ad None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.656493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.688378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.688993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.689280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.689551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.690240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:23.690544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.691911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.692691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a5aef-a62f-4696-a31a-a1339d54834c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.703911 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 313/635] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:23.704725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.727111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.727742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.728058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.728334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.738373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fe0bbafb-26b3-49d1-9df2-fc89f0d1b6d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:23.743786 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:23.744904 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:23.745766 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 323/636] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:23.747056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12338-a2d3-4bc7-80a0-97aeeaef2bf7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.747339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12338-a2d3-4bc7-80a0-97aeeaef2bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.747615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e12338-a2d3-4bc7-80a0-97aeeaef2bf7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.748910 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 324/637] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:23.750250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e12338-a2d3-4bc7-80a0-97aeeaef2bf7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.812113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5109-d8d9-4929-b2a5-bd3bc474dfbe None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.837090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.846280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.846903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.847182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.847457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.848228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:23.848532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.849907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.853187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e12338-a2d3-4bc7-80a0-97aeeaef2bf7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:23.857991 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 314/638] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:23.858770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.887376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:23.889098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:23.889805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:23.890092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:23.890372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/4d58f02ebba84bf0b29ef054b7d8cc8f/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:23.904993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=4d58f02ebba84bf0b29ef054b7d8cc8f, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:23.906370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:23.919312 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 325/639] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:23 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/4d58f02ebba84bf0b29ef054b7d8cc8f/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:23.920219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:23.969969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e4cd6-261e-4b4d-a121-80c3aee8a66b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.015630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.016080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.016369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.016646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.024306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.025792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6d37decd-4d00-4b44-a632-5159687648de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:24.040419 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:24.041398 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:24.042336 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 315/640] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:24.043965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.044291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.044520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.056658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d8dc-1258-4bcd-b218-c74e8c9d13bc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.063376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:24.064619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:24.101991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.102609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.102947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.103164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.103873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.104238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.106207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.108521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.120200 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 326/641] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.121114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.142302 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 316/642] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:24.143357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.167424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.235105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a533a-ff46-4f54-bbc1-a1ff244b5292 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.254255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac6d2d-bbf0-475e-a849-378ee67a3165 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.271108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.272070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.272537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.272973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.285338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.286940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.289646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.290274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.290561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.290839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.291596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.291905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.293524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:24.303038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:24.304174 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:24.305188 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:24.305188 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:24.305188 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:24.305188 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:24.305417 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 317/643] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.305729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.306916 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 327/644] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:24.312754 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.369193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.394717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.420599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078615f3-9a2d-4aa8-a9a0-549e47c0c312 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.422938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2506-49a8-44d5-924b-1ef99e552151 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.462077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.462773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.463054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.463371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.464568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.465830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.466143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.466387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.476928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.477467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:24.478727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:24.484306 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:24.485422 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 328/645] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:24.491901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:24.499488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:24.500580 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:24.501701 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:24.501701 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:24.501701 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:24.501701 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:24.504457 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 318/646] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:24.505634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.598230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14582-8902-4618-879d-4ca28d353fa8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.609295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.614629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35220a9f-72d8-446b-bc08-4035a14f054f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.637155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.637906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.638435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.639091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.640277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.640685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.641897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.642906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.650542 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 329/647] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.650851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.651643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.651762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.652704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.653152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.654010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.654476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.656048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.674677 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 319/648] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.679899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.785119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e130-9e0d-4c72-91da-635558073b9b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.798618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d91ec-bbca-412a-9343-55d79d35bf12 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:24.830555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.831253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.831602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.831813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.832561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.832948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.834227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.844779 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 330/649] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.844948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:24.845494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:24.845596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.845781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:24.846171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:24.846863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:24.847172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:24.852782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:24.866472 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 320/650] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:24.868108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:24.898594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.931976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:24.985734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eeff1-c0ad-4dc9-bb7d-77a6de1b17a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.004914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66e44e-64ca-4bb7-90ca-2a2f9e759f9a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.023723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.024404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.024685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.024963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.033347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.034827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:25.048778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:25.049778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:05:25.050715 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:25.054748 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 331/651] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:25.055743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.056677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.057560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.058065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.059470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.074661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.077405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:25.098615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:25.099565 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:25.100481 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:25.100481 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:25.100481 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:25.100481 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:25.103601 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 321/652] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:25.104692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.168315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.178101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8bb9-8048-4262-b72e-ec4ac49df98e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.224379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82e53e-f3c4-4052-b13e-f9919e04d814 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.229298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.231914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.233396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.233933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.244280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.247407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:25.261240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:25.262671 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 31 01:05:25.263596 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:25.264170 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 332/653] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:25.269454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.282741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.283407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.283695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.284303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.284871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:25.285177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.286731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.310051 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 322/654] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:25.310957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.410744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29343f18-420e-4d78-ad17-ba0a19f2da6b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.423703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163dd472-64be-4778-aeb9-c09d4170d2e3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.452816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.453443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.453758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.454039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.454781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:25.455087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.456686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.469117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.470131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.470641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.471138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.471329 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 333/655] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:25.472300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.472582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:25.473085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.474759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.492018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.500130 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 323/656] 10.222.0.47 () {56 vars in 1137 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:25.501331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.522244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.581053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778dcd8-5b72-48d9-8e38-21d0de1c1984 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.616171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.616892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.617243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.617586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.621986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d7d8a-b67b-48ec-b02d-66fdf1f5263b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.662043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.663299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.664020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.664733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.674259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.677319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.690357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.691798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:25.692080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:25.692981 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 31 01:05:25.693911 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:25.696854 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 324/657] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:25.697922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.710988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.788335 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.802338 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 334/658] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:25.803577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:25.817276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7266-4aee-459d-8ec8-5c3f4b405ee4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.856761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.857769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.858310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.858790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.907214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1d373-087f-4241-9ed2-18fb45138092 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:25.924420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:25.939514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.941488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e2e37-3f76-4b9d-aa27-f355b2df77b0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.942728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:25.943377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:25.943656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:25.943948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:25.945315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:25.945627 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:25.947121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:25.971832 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 335/659] 10.222.0.47 () {56 vars in 1139 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:25.971832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.031949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.060472 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 325/660] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:26.061721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3331-44ea-49fa-accb-edd802d09411 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.062014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3331-44ea-49fa-accb-edd802d09411 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.062288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3331-44ea-49fa-accb-edd802d09411 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.067577 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 326/661] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:26.067577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3331-44ea-49fa-accb-edd802d09411 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.094382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a3af9-a59a-448f-8ef3-f07330e41c76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.130709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.131352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.131629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.131902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.142648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.144113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:26.158307 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.159292 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 336/662] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.160885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.185516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3331-44ea-49fa-accb-edd802d09411 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.190509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.225153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.225877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.226156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.226433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.266988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82730048-74ba-4b2e-b5c3-123caee44cf7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.275623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.301839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.302836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.303287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.303495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.303768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.304077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.315812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.317223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e158d16b-5799-4326-b223-3e4d83a185bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:26.332701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.333612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.335512 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:26.335512 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:26.335512 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.335512 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:26.335512 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 337/663] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.335815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.336103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.336216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.356643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:26.357979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:26.417195 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 327/664] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:26.419628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.432638 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 338/665] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:26.434497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.453888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.511094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.535471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ccece-fe35-4560-942f-bd80a2f39afc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.551793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad093ea-239a-4293-ab50-a9f5da80df00 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.572973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.573670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.574464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.574464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.575205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:26.575510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.576918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.590403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.591021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.591303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.591577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.592307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:26.592609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.593029 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 328/666] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:26.593918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.594020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.606737 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 339/667] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:26.607386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.674739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.711773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c29-67f8-4c33-97b7-04d3bbb78e40 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.712416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073c953-a5b5-4861-827f-fc25d2ff9226 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.749319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.749953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.750242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.750497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.751052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.751797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.752213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.752716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.756182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.761004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:26.766421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:26.766968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.768069 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:26.773939 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 340/668] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.774811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.774896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:26.793363 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.794453 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.795525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:26.795525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:26.795525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:26.795525 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:26.796837 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 329/669] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.797447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.884146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33bb84-ddf7-4c0d-b635-4b062bfa8606 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.904415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194336d-0120-45e6-a683-4d851aae0406 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:26.910590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:26.920069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.920713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.920997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.921275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.927882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.929361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.937994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:26.938630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:26.938914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:26.939187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:26.941410 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.942449 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 341/670] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.943531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:26.948498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:26.950597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:26.962193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:26.963169 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 330/671] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:26.964112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.012214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.050713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d6de-fa8a-4846-950c-092e7e911e89 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.061620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f33c-59d0-46fa-afe3-0a0b679035b8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.085307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.085916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.086199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.086487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.087193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.087501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.088883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850090fa-232a-4da9-b281-5b61e32c47e4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.096033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.096675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.096961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.097241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.097932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.098031 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 342/672] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.098242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.099153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286991-0df3-4fdb-a9d5-8d51a7133c5e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.099423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286991-0df3-4fdb-a9d5-8d51a7133c5e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.099610 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.099717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286991-0df3-4fdb-a9d5-8d51a7133c5e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.101104 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 343/673] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:27.101602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef286991-0df3-4fdb-a9d5-8d51a7133c5e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.114713 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 331/674] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.115539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.158929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.210594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef286991-0df3-4fdb-a9d5-8d51a7133c5e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.214015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b613258-79eb-4a44-8ad3-a69e74a5669d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.224533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.244069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.244616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.244911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.245190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.245975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.246284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.247714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.249538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.250153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.250430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.250702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.251435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.251737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.253197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fca948-a83c-49d4-b6a9-c94910bdabd6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.259626 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 344/675] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.260448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.273598 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 332/676] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.273598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.273598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.273598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.289442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:27.290654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:27.355585 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 333/677] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:27.356440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.358603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538dd764-f983-4f02-bf19-d9061b406ccb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.369666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.396048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.396954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.397235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.397511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.408002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.409501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:27.424550 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:27.425650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 345/678] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:27.426863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.461910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.466209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed0d9a-bd79-414b-9383-5ba3fe3968f3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.500923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.501559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.501841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.502115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.508715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.510156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:27.522710 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:27.523982 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 334/679] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:27.525051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.535369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cbac-4b03-4a2f-98d2-c05dc7974318 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.570828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.571433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.571710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.572007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.572784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=8d1d0d00aea849cb97808332cb98cfbf) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.573087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.574724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.580450 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 346/680] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/role_assignments?user.id=8d1d0d00aea849cb97808332cb98cfbf&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.581230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.614460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.628986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87424c-eb20-4ce1-b5fd-453f09197658 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.669680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.670337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.670679 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.671013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.671881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=ce143d790f1745f2b66494b85f1fb66e) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.672283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.673807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.680271 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 335/681] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/role_assignments?user.id=ce143d790f1745f2b66494b85f1fb66e&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.681115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.707012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c65be-68d6-4693-91e1-b04e8477f86e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.715775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.756306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.756980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.757258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.757533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.775791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:27.783462 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:27.784800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:27.785731 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 347/682] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:27.786539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.842163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bfc4d-6dad-410f-a603-72c7d3743acd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.884937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.885570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.885945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.886229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.886981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.887288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.888698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.895770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:27.904402 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 336/683] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.905322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:27.924459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ed8be-c222-4925-8d1e-f1b9c61921a3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:27.971371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:27.972018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:27.972304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:27.972578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:27.973649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:27.973649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:27.975047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:27.993589 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 348/684] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:27.993589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.022796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:28.049206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326413-7e33-4ce9-8bd3-f852a2ce37d5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.098098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.099002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.099355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.099974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.101052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:28.101362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.103223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.109293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d60d36-c5a0-44db-b981-35b022322a4f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.113969 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 337/685] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:28.119159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.161830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.163876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.164390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.164859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.175402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.177701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:28.194831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:28.195826 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:28.196819 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:28.204042 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 349/686] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:28.204042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.219410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:28.249236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcbf27-0c15-423f-84ee-6c50e4930803 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.284380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.285326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.285609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.285929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.286735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=5ba914491e3643158d83fd51fbfc6263) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:28.287017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.288469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.299974 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 338/687] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/role_assignments?user.id=5ba914491e3643158d83fd51fbfc6263&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:28.299974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.330470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:28.380125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc79ae-de28-4802-9f22-f7ad159b1b68 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.467958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.468612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.468895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.469172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.516890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.518383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.552888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cabac-f67f-4126-8fb2-83c8c6ed4e14 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:28.566562 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:28.567542 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:28.568473 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:28.568473 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:28.568473 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:28.568473 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:28.568473 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 350/688] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:28.590531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.605488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.610107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.610637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.611142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.612197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:28.612729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.614380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.640807 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 339/689] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:28.647598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.711388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:28.761718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedaf0f8-5aa1-4d27-a5e6-6079ee615dd9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.824519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:28.828398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:28.828398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:28.828398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:28.828713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:28.829231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:28.829540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:28.830966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:28.859750 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 351/690] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:28.865212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:28.904167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abbb58-77a0-4ac3-9baf-9e8cec321ea5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:28.988336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb638b-e7ea-4ae2-bf99-0cc479c12e13 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:29.000813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.001471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.002051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.002051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.010248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:29.046913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.048043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.048469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.048968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.073517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.075614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.099295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.099295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:29.101779 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:29.102942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:29.104079 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:29.106868 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 352/691] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:29.112302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.203332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:29.249407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1bbe6-a802-4685-8d54-da63e74d2beb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:29.274159 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 340/692] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:29.280579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.336631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.337639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.338144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.338487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.339357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:29.340345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.342016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.379338 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 353/693] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:29.386513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.407436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa143471-ae52-4d49-9ee5-0313485faf13 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:29.461496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:29.475260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.477724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.478019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.478298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.500026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.501792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.634957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b092c-71a8-4114-850c-33270ec2ec10 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:29.655959 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:29.656915 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:29.657801 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:29.657801 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:29.657801 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:29.657801 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:29.657801 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 341/694] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:29.658726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.692602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.693259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:29.694781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.695282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.695757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.791067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.797700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.829563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24308-c07f-4a7a-9bcc-74973c253682 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:29.840608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:29.869183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:29.870180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:29.870679 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:29.871223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:29.872185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:29.872711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:29.874302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:29.887154 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 342/695] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:29.892145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.947059 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 354/696] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:29.953035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:29.988192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.015072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1ce82-f137-4eda-8e39-c35023d676d5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.051776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.052953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.053438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.053927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.062270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.064675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:30.077488 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:30.078379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:30.079280 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:30.081827 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 343/697] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:30.087297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.141679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086ea0a-35c1-4e76-be8d-de46b8ce7825 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.178332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.179340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.179849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.180424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.183661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.194246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.195706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d8ab357c-fb3a-48cc-aebb-ddae6cf821c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:30.211183 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:30.212380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:30.213266 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:30.213266 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:30.213266 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:30.213266 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:30.213493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203512-4033-430f-9c34-b921b09cd60c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.213566 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 355/698] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:30.213883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626bdc-2389-49ca-92b4-f9e23fe6c9aa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.214174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626bdc-2389-49ca-92b4-f9e23fe6c9aa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.214458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa626bdc-2389-49ca-92b4-f9e23fe6c9aa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.216763 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 356/699] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:30.218025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520fe4-b942-47d3-bbfe-b31e03a13600 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.218316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520fe4-b942-47d3-bbfe-b31e03a13600 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.218592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c520fe4-b942-47d3-bbfe-b31e03a13600 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.219961 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 357/700] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:30.220534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520fe4-b942-47d3-bbfe-b31e03a13600 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.258414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.258652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.258846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.259051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.259793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:30.260150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.262636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c10e3c-c2e7-4511-b63b-f3008bc3e73d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.270372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.275839 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 344/701] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:30.278037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9e20-680d-4379-86bb-4da65940447c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.278505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9e20-680d-4379-86bb-4da65940447c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.278964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9e20-680d-4379-86bb-4da65940447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.297161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2bdc9e20-680d-4379-86bb-4da65940447c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:30.298417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2bdc9e20-680d-4379-86bb-4da65940447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:30.332953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c520fe4-b942-47d3-bbfe-b31e03a13600 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.368622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.369249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.369533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.369812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.370500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:30.370840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.372769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.373190 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 345/702] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:30.374660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.374949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.375224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.401046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:30.401327 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 358/703] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:30.402805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:30.403593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.462564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.487958 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 346/704] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:30.487958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.533884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a339dd-f0df-46e8-8ffd-7b585241cd7d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.541726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.572623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.573245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.573532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.573808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.574623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4d58f02ebba84bf0b29ef054b7d8cc8f) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:30.574941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.576441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.582576 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 359/705] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/role_assignments?user.id=4d58f02ebba84bf0b29ef054b7d8cc8f&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:30.583417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.606434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36101296-327c-4fe5-8ef5-4ac7ac723fe2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.648207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.648737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.649015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.649291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.662518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.665009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:30.685034 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:30.686092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:30.686983 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:30.686983 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:30.686983 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:30.686983 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:30.692065 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 347/706] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:30.693371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.705484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a8e1-a338-4ddf-9514-40b3c3f21d01 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.721333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.747112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.747830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.748170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.748452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.756394 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.757883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:30.771529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:30.772482 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:30.773350 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 360/707] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:30.773838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.832678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96184f-fc75-4bc0-a6f5-c60c5207bfeb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.849635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:30.878997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.879645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.879973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.880256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.880884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.882238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:30.897626 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:30.898841 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:30.899861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 348/708] 10.222.0.47 () {56 vars in 1129 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:30.900920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:30.914815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab78837-a570-4f88-a2ba-76ea682a017a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:30.953427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:30.954053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.954342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.954625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.955324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:30.955638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:30.957080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93638cf-bb14-4e33-ad24-a55ab11bd5ff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:30.970187 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 361/709] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:30.971463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da6ce-fc5a-4d43-a18e-72014a68bc59 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:30.971752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da6ce-fc5a-4d43-a18e-72014a68bc59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:30.972075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da6ce-fc5a-4d43-a18e-72014a68bc59 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:30.973502 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 362/710] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:30.974091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3da6ce-fc5a-4d43-a18e-72014a68bc59 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.009244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.021583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61585be5-67db-46ea-8cd7-a256554b5357 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.058069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.059444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.059746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.060070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.060899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:31.061203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.062622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.077081 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 349/711] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:31.077744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.087261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3da6ce-fc5a-4d43-a18e-72014a68bc59 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.116472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.127117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.128082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.128378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.128806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.129503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:31.129812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.131188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9730f1-79bb-4f33-8ad7-0366aa5868f1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.140864 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 363/712] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:31.140864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.140864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.140864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.156837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:31.158088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:31.197694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6c8b-5faf-46d3-83e5-5e770ad85bf3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.229671 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 364/713] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:31.239364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.240263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.240724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.240842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.241321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.242170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.244966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.275969 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 350/714] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:05:31 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:31.275969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.292344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.369291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd0a43-eba5-4d1f-aa79-ab9adfffb019 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.405096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.412819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.413579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.413985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.414365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.415271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:31.415696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.417368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.421482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbfea-ddc1-4ab8-84d2-c7168e63e827 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.424491 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 365/715] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:31 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:31.425450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.501124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.501893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.502176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.502446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.503143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:31.503445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.504868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.513377 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 351/716] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:31.567720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:31.579368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fe610-e682-46e9-8812-fb9c7105a1ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.621892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.622513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.622802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.623080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] PATH_INFO: `/v3/services/network` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.623726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.625973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:31.639436 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:31.640529 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:31.641350 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 366/717] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:31 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:31.648894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.773174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359bc89-2c6d-4060-a3f0-f01014e095d0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.810551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.811176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:31.811454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:31.811723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:31.812435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:31.812733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:31.814089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5f42b-1a95-4d95-b033-d867048fb1a4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:31.819209 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 352/718] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:31.824923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:31.958724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb68b-344a-41da-bdcc-cd264adccd78 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:31.999220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:31.999850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:32.000156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:32.000435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:32.001124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:32.001427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:32.002811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb672003-6e26-464f-a460-93d3a11c446e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:32.020191 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 367/719] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:33.012887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625765-f7f9-4e46-b4c9-02869ce8c618 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:33.013418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625765-f7f9-4e46-b4c9-02869ce8c618 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:33.013524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0625765-f7f9-4e46-b4c9-02869ce8c618 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:33.015022 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 353/720] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:33.020526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:33.020948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:33.021136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:33.055721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:33.056966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:33.076751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:33.154880 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 368/721] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:33.201501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0625765-f7f9-4e46-b4c9-02869ce8c618 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:33.222317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:33.340794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0625765-f7f9-4e46-b4c9-02869ce8c618 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:33.383048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:33.383698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:33.384007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:33.384292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:33.401110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:33.407109 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:33.408080 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:33.408908 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 354/722] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:33.414224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:33.555129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4f51c-0270-491b-87f0-cc9782f78403 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:33.595592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:33.596589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:33.597106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:33.597580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:33.598505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:33.599009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:33.600632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:33.610457 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 369/723] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:33.616091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:33.713393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:33.749559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aac881-2fa9-4cab-bede-f1bd98d8146b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:33.793044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:33.793702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:33.793990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:33.794267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:33.805619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:33.807078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:33.822485 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:33.823460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:33.824973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:33.824973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:33.824973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:33.824973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:33.824973 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 355/724] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:33.830579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:33.855607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:33.981132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469a5b4-6bae-4a8f-90b8-8bc063642edc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.041598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.042229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.042489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.043333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.044171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:34.044477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.045840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3eba-5e2e-4d11-b591-5c45236f98b6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.062793 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 370/725] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:34.068106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.080001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6e8c-7651-4b62-9b59-f217fc9e88cc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.080001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6e8c-7651-4b62-9b59-f217fc9e88cc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.080001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c6e8c-7651-4b62-9b59-f217fc9e88cc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.080685 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 371/726] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:34.086344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a67d-91a1-4dc9-ac10-29473fe2e8d1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.086885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a67d-91a1-4dc9-ac10-29473fe2e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.087354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a67d-91a1-4dc9-ac10-29473fe2e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.122206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6746a67d-91a1-4dc9-ac10-29473fe2e8d1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:34.123745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6746a67d-91a1-4dc9-ac10-29473fe2e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:34.183991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64586f-2f6e-43ec-8997-ec453edf5c25 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.216312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.221108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.222004 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 372/727] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 31 01:05:34.223480 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7aa4-a4ec-4612-ad44-4c61a05ef012 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.224034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7aa4-a4ec-4612-ad44-4c61a05ef012 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.224638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf7aa4-a4ec-4612-ad44-4c61a05ef012 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.226754 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 373/728] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:34.232148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.232698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.233213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.247402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.248109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.248394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.248668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.253567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:34.255012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:34.263225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.264719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:34.279814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:34.280868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:34.281821 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 356/729] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:34.282441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.336126 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 374/730] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:34.337195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.407048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c39b-63e8-4495-bdf3-f6870a695f85 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.448685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.449571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.449772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.450029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.454429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8de6e-4e69-40be-b424-6635ca677aed None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.461300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7d0cfa74-de74-4714-8557-c79d6308d4dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:34.467396 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:34.468352 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:34.469250 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 357/731] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:34.469944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb11a3-4e1c-42f2-b7a7-7a87168300a9 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.470020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb11a3-4e1c-42f2-b7a7-7a87168300a9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.470744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb11a3-4e1c-42f2-b7a7-7a87168300a9 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.471591 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 358/732] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:34.476166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb11a3-4e1c-42f2-b7a7-7a87168300a9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.495955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.503265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.503896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.504217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.504558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.505359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:34.505722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.507157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.532759 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 375/733] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:34.532759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.533425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.586928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb11a3-4e1c-42f2-b7a7-7a87168300a9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.620687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.621394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.621681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.621950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.622632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.624007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593a93-fdef-4df7-b025-78ce5d52a4b7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.631299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67433f80-52f2-43c3-8789-bafe7b788285 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.639078 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 359/734] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:05:34 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:34.640542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1527-da8e-4186-86c6-541c6cc73311 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.640841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1527-da8e-4186-86c6-541c6cc73311 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.641120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a1527-da8e-4186-86c6-541c6cc73311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.660708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b22a1527-da8e-4186-86c6-541c6cc73311 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:34.661869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b22a1527-da8e-4186-86c6-541c6cc73311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:34.692151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.692807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.693100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.693390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.694131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:34.694443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.695897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.705990 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 376/735] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:34.706866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.745522 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 360/736] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:34.756164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347900-69d9-4749-bb23-f94583db0819 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.756164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347900-69d9-4749-bb23-f94583db0819 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.756164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73347900-69d9-4749-bb23-f94583db0819 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.756164 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 361/737] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:34.756164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73347900-69d9-4749-bb23-f94583db0819 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:34.774159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.811271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:34.839793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00490097-3b2b-4c8c-b030-9e28da93c63f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.878297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73347900-69d9-4749-bb23-f94583db0819 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:34.879244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.879894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.880237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.880521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.915473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:34.916068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.916355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.916636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.927887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.929396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-65ed8d33-f2ab-4eb8-958d-e54933bc9a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:34.945444 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:34.946517 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 362/738] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:34.952122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:34.960513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:34.962099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:34.966950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:34.968191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:35.014079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.055963 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 363/739] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 31 01:05:35.055963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.083777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.172035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70590c-75d5-4605-80ab-0e3932a4a8c9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.193241 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 377/740] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 31 01:05:35.193241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.214011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.214795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.215393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.215503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.226133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:35.231204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:35.232371 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:35.233221 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:35.237256 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 364/741] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:35.238072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.299144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e8d0-79c1-4808-ae36-e8430b61fccd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.325044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.336363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.337064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.337415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.337768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.338534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:35.338906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.340399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.346132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161588ec-42ab-4648-bfcb-b24ad64521ca None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.356838 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 378/742] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:35.357798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.366831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.383710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.384365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.384654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.385115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.385621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.387907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.407981 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 365/743] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:05:35 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:35.407981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.500954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e5ba-e029-42d6-ab46-98c61d47cf0b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.546915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44abd-1e8d-4b82-bce6-d7af33dad335 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.549568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.550439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.550887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.551398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.564283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.566021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:35.582577 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:35.583477 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:35.584451 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:35.584451 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:35.584451 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:35.584451 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:35.584451 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 379/744] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:35.584999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.596289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.596921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.597210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.597491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.598215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:35.598524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.599899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.607011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.617700 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 366/745] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:35.617700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.668485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.727714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975934-6728-47d2-9b70-7ea04b6c9c2f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.732606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f7f9-5168-4923-8e7c-afefce4db90a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.771660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.772498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.772877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.773251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.774469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.775092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.775651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.775950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.777300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:35.777613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.779179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.782928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.784541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.794773 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 367/746] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:35.795763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:35.798984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:35.800193 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:35.801424 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:35.807968 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 380/747] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:35.808891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.871563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.919019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3228c1e-9fef-4662-b206-c97b761ff764 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.926677 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e4a48-835a-4720-9cc4-79062f42306a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:35.940980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:35.955451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.956164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.956545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.956903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.964306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:35.965654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:35.966082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:35.966509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:35.969906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.971414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.977694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:35.979449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:35.986929 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:35.988041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:35.989152 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:35.989152 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:35.989152 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:35.989152 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:35.994970 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 368/748] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:35.994970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:35.997212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:35.998257 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:35.999334 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:36.000971 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 381/749] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:36.002720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.129949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb71a4d-7491-4e9c-ad93-9ef3f1efaa52 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.134839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b180ce-7ec9-4b78-947b-3db17a68d18d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.153485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.174728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.175504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.175882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.176292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.177061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:36.177463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.179157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.185042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.185861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.186293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.186717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.188341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:36.188803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.191258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.197132 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 382/750] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:36.197132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.221267 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 369/751] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:05:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:36.222376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.244613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.335535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2b94-e0ee-4703-a78d-0a3e3dc56ecf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.350867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6c20d-82a7-4493-9633-72e29e94c7ca None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.372638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.373239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.373517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.373788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.374534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:36.374839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.376359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.389266 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 383/752] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:36.389918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.398788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.400300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.400797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.401763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.413099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.415656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:36.435092 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:36.436131 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:36.437108 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 370/753] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:36.446360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.492106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.508687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.517524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e90e73-3a02-407b-aedb-ba151ae34c19 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.556178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.556822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.557146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.557425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.599012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4244b2-c6f9-4f1a-bbc4-74981e7f6239 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.631485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.632839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418008-b61a-44ba-906f-e9d43459ef21 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.647426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.648658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.648968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.649245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.650044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4d58f02ebba84bf0b29ef054b7d8cc8f) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:36.650353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.651818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.661201 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 371/754] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/role_assignments?user.id=4d58f02ebba84bf0b29ef054b7d8cc8f&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:36.662478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.749685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.765293 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 384/755] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:36.766475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551d44-dcab-4488-be5e-ba9019838976 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.766867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551d44-dcab-4488-be5e-ba9019838976 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.767182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551d44-dcab-4488-be5e-ba9019838976 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.769039 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 385/756] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:36.770872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551d44-dcab-4488-be5e-ba9019838976 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.799159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:36.807463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b63b92-5281-41ab-b4c7-2fd93e6ef38f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.858212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.858853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.859139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.859417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.860260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:36.860699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.862284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bac1dc-0ff1-4f95-866d-f74a0be3c1b5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:36.881934 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 372/757] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:36.883237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.883529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.883811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.902751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:36.903852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:36.921707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551d44-dcab-4488-be5e-ba9019838976 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:36.967004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:36.968184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:36.969003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:36.969740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:36.976524 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 373/758] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:36.977488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:36.983400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:36.985215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:37.005289 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:37.006201 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:37.007076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:37.007076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:37.007076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:37.007076 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:37.009244 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 386/759] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:37.012031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.071490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.088346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.097835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223fbf7-5590-4ff0-9fad-deced7973179 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.130424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234ae75-1491-4983-8aea-d469ff172a8a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.135289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.136649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.137178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.137647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.151443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.154480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.171557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.172599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.173091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.173599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.174433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.176043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:37.176591 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:37.177441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:37.178346 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:37.178346 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:37.178346 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:37.178346 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:37.182389 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 374/760] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:37.184297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:37.192670 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:37.193832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:37.194876 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:37.197977 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 387/761] 10.222.0.47 () {56 vars in 1129 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:37.199968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.303731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca3e-797c-489d-b04a-1810400cea9e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.335279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fde22-142f-4bf4-b22d-7c647e0fb6b8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.342411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.343160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.343563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.343982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.344889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.345345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.346962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.348447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.350066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.367047 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 375/762] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.368349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.376660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.377287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.377579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.377863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.378563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.378872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.380613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.398735 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 388/763] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.398735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.515390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b7d2f-41be-444b-a3cf-08a88c01a82b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.530725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce3238-d639-478f-a6bd-28a1536be152 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.557769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.559616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.559879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.560208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.560964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.561286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.563318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.571424 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 376/764] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.573287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.576331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.577232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.577713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.578342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.587528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.590005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:37.603906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:37.604822 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:37.606365 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:37.610635 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 389/765] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:37.611504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.648997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.649513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.693352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9948-d84c-416f-89e0-6720d61d1827 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.729878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea104-a836-43de-b1dc-cc600a7e4247 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.730578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.731223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.731518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.731780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.739302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.741012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:37.752432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:37.753320 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 377/766] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:37.759209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.778063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.778690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.778976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.779255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.779963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.780278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.781645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dd70b-d8f5-4c67-937d-50e355b1c95a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.786855 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 390/767] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.792790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99691-38b4-465a-bbaf-5d538e6a60c8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.793082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99691-38b4-465a-bbaf-5d538e6a60c8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.793371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f99691-38b4-465a-bbaf-5d538e6a60c8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.794658 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 391/768] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:37.795360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f99691-38b4-465a-bbaf-5d538e6a60c8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.880113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68818910-451e-4e4d-b131-995a6e5ec7e2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.898532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.903105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:37.912474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f99691-38b4-465a-bbaf-5d538e6a60c8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:37.916671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.917281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.918154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.918510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.919255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.919559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.921007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.936257 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 378/769] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.938028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:37.948350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:37.949004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.949289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.949569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.950315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:37.950623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:37.952097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6352147-c38b-454d-a008-b9527ce54e05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:37.970337 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 392/770] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:37.970337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:37.970337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:37.970337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:37.986444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:37.987662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:38.048559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf211c-e5a5-42f7-9140-375095f185d6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.066361 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 393/771] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:38.067003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.107405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.108151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.108437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.108710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.109467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] RBAC: Adding query filter params (interface=public, service_id=26c49f1861bb4b419a759b8cd838ccae, region_id=RegionOne) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:38.109775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.111143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.118628 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 379/772] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:05:37 2022] GET /identity/v3/endpoints?service_id=26c49f1861bb4b419a759b8cd838ccae&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:38.119382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.163549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:38.164686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:38.181313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35e7c5-e632-4ccf-8902-fad4305085cb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.221314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.222105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.222306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.222580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.223412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4f1f366465294ed69b534136c7daf9fc) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:38.223728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.225181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.226093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b8963-fad2-458a-8cda-eba7b113b3a2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.231647 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 394/773] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/role_assignments?user.id=4f1f366465294ed69b534136c7daf9fc&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:38.232483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.283815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.284778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.285230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.285666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.289180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=6f8bf5d3a0014e24af8195f4cdb1bf66, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.291696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.313519 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 380/774] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:38 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:38.315297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.412557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6955ab-67ab-4c33-b676-db66d98fe4d8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.484696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.485367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.485652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.485928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] PATH_INFO: `/v3/services/network` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.486565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.487959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:38.500221 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:38.501236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:38.502049 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 395/775] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:38.508180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dac3b7-2701-41f4-8c4c-6e91259bece0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.508913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.511538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:38.536316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:38.555675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.556349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.556638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.556920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.557583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.559753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.567523 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 381/776] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:38.634443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29a086-8654-435c-a71c-58fc4c440c7a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.673203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.673840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.674120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.674397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.675103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:38.675411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.676869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf940751-c0c0-4377-bf46-28ed3a2b787a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.682475 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 396/777] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:38.689521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.805902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fce5-5c2b-440e-a721-a2a52fc4e9ca None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.806199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fce5-5c2b-440e-a721-a2a52fc4e9ca None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.806382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fce5-5c2b-440e-a721-a2a52fc4e9ca None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.809223 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 397/778] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:38.814409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.814735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.815093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.836326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dbf28-7da3-4d04-80c7-b3e4b365a05e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:38.838806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:38.840615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:38.888791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:38.889877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:38.890367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:38.890889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:38.891786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:38.892327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:38.893903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:38.900155 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 382/779] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:38.906191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.925904 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 398/780] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:38.943590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:38.961663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:38.976050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:39.070929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6c34b-5dbb-437e-851b-4f02dc7bc1c9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.124154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.124785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.125068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.125399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.126185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] RBAC: Adding query filter params (interface=public, service_id=9088cea050b1491bb592b1aa87107978, region_id=RegionOne) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:39.126553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:39.127953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:39.134166 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 383/781] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/endpoints?service_id=9088cea050b1491bb592b1aa87107978&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:39.139745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:39.173041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001edf3d-026c-4e8e-a742-d68e3b119fa6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.242007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.242679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.242930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.243209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.271093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:39.276142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:39.277106 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:39.277940 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:39.284214 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 399/782] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:39.286476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:39.315816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:39.328967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36609477-d791-425b-943b-2dc116b33dc6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.393761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.394435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.394727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.395009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.395672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:39.397077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:39.406598 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 384/783] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:05:39 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:39.428362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:39.469420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b340-4953-4ebc-a54e-407b575743b4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.511019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.512287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.512567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.512845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.513671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:39.513987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:39.515416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:39.525248 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 400/784] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:39.533475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:39.659875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e5a5-bfe0-493b-ac34-6993a69c339f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.702159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.702816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.703104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.703381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.716383 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:39.717895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:39.734504 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:39.735416 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:39.736340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:39.736340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:39.736340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:39.736340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:39.736340 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 385/785] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:39.741243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:39.861889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11df76-6193-41a9-bd1a-d9474284ef66 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:39.889879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:39.904390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:39.905320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:39.905807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:39.906310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:39.907208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:39.907719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:39.909349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:39.922906 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 401/786] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:39.928105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:39.954029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:40.056420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5816e-d954-4679-b3c5-5f791aa2ab06 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:40.095559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:40.096348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.096643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.096994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.105578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:40.107076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:40.118993 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:40.119978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:40.121551 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 386/787] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:40.129262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:40.280257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cccc4-660b-4a60-8c51-4cfc2312e260 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:40.326895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:40.327543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.327828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.328139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.328960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:40.329280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:40.330773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:40.355832 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 402/788] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:40.361458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:40.437384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:40.482860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38682b-d818-42e9-a0c8-b031b0e78583 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:40.530888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:40.531486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.531762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.532054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.548190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:40.550030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f4d06ad9-88c8-4460-96f3-f99a9cc02fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:40.571769 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:40.572727 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:40.573603 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:40.573603 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:40.573603 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:40.573603 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:40.573603 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 387/789] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:40.579336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:40.626851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2d4b-7bc4-45ca-8032-61dc82aa325d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.627169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2d4b-7bc4-45ca-8032-61dc82aa325d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.627392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2d4b-7bc4-45ca-8032-61dc82aa325d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.629001 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 388/790] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:40.635966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc9ae-c6fd-46c6-aeef-d61306acc61b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.635966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc9ae-c6fd-46c6-aeef-d61306acc61b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.635966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc9ae-c6fd-46c6-aeef-d61306acc61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.655790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-28dcc9ae-c6fd-46c6-aeef-d61306acc61b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:40.657022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:40.658434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-28dcc9ae-c6fd-46c6-aeef-d61306acc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:40.751571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1699aa-303b-437c-b27a-8a2ac967cc97 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:40.786505 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 389/791] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:40.807983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:40.808643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.808925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.809201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.809913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:40.810197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:40.811569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:40.824675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60886-dce7-4b42-9108-c03e8c492a46 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.824953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60886-dce7-4b42-9108-c03e8c492a46 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.825225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a60886-dce7-4b42-9108-c03e8c492a46 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.826564 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 390/792] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:40.831778 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 403/793] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:40.835911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:40.836373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:40.836662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:40.836936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:40.858334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:40.859641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:40.923744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:40.952141 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 391/794] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:40.953124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:40.958709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652037a3-6431-4470-bdbf-a253237e47a7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:40.972807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.011258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.013042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.013582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.014063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.029403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:41.038096 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:41.039000 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:41.039831 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:41.044322 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 404/795] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:41.045444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.091880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61089d5-2ff6-46a7-b08c-3f5024d09a43 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.131381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.132050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.132336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.132611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.139870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.141407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:41.161301 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:41.162193 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:41.163071 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:41.165517 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 392/796] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:41.166447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.180972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f06b6-a53a-42cb-b0a3-ef4bb60d5b47 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.215869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.225382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.226021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.226577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.226903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.238709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:41.243614 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:41.244579 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:41.245437 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:41.249701 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 405/797] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:41.250615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.280118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.295561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df21bf5-34e1-4ae6-9d69-97760c636b4d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.334017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.334675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.335218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.335495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.336360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:41.336667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.338191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.351798 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 393/798] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:41.352688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.378714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbadeb-76bc-40fa-9262-91bad27afe1a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.412475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.413094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.413377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.413653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.414398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:41.414705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.416157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.428159 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 406/799] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:41.428833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.472809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a053a3c-aee1-4f81-a185-337886bfdcfc None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.476224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.510220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.510849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.511136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.511540 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.512350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:41.512663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.514172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09458d2c-d66b-4bf2-839f-0567f1b64d54 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.522633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.522923 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 394/800] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:41.524281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183e31-442e-4195-b3d2-797f8fd0de4c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.524574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183e31-442e-4195-b3d2-797f8fd0de4c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.524851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183e31-442e-4195-b3d2-797f8fd0de4c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.528221 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 395/801] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:41.528221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d183e31-442e-4195-b3d2-797f8fd0de4c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.544547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ded9-f9d6-4fe2-a448-c9e8e6ead670 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.581540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.582191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.582476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.582757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.594372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.596369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:41.611857 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:41.612783 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:41.613679 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:41.613679 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:41.613679 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:41.613679 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:41.613679 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 407/802] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:41.614736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.643176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d183e31-442e-4195-b3d2-797f8fd0de4c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.685785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.686454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.686739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.687017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/4d58f02ebba84bf0b29ef054b7d8cc8f/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.689025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=4d58f02ebba84bf0b29ef054b7d8cc8f, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.690484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ff6a3-d8ad-46fa-ada8-f00422078f98 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.705072 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 396/803] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:41 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/4d58f02ebba84bf0b29ef054b7d8cc8f/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:41.717173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.717486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.717737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.732075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90522872-715e-4ac4-8b19-f131cb2fc738 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.743671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:41.745387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:41.771842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.782711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:41.784075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:41.784786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:41.785312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:41.796596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:41.803668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:41.806155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:41.827863 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:41.828832 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:41.829692 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:41.829692 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:41.829692 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:41.829692 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:41.832805 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 408/804] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:41.833949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.841867 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 397/805] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:41.842922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:41.965671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a89029-4788-484c-9f36-1b209c1fdd71 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:41.969775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8523931-b832-4d19-8be3-178cd017f8b1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.001285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.002299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.002844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.003171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.003815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.004152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.005513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.006469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.007096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.007369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.007650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.008387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.008695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.010065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105d37c-c292-47d4-8a8b-6fa0bc722521 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.018387 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 409/806] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.019433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.026730 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 398/807] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.028873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634356-a007-432b-8f7e-d0aa6500070f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.029400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634356-a007-432b-8f7e-d0aa6500070f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.029745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba634356-a007-432b-8f7e-d0aa6500070f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.031187 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 399/808] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:42.035718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634356-a007-432b-8f7e-d0aa6500070f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.056353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.080049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.135026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea6ae4-53b5-474d-b259-3b490cb7bdf6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.159459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba634356-a007-432b-8f7e-d0aa6500070f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.171739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.172410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.172690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.172965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.173586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.174943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:42.184637 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:42.185568 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:42.186421 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 410/809] 10.222.0.47 () {56 vars in 1129 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:42.187245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.203837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.204512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.204796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.205068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.213459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.215123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3e3b9de3-11a7-4042-93c8-e7692172932d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:42.226838 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:42.227866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:42.228856 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 400/810] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:42.230460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.230460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.230627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.251881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:42.253179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:42.301869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da75fd-2a99-40a4-b29e-43f4b53fff23 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.315980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.329693 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 401/811] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:42.330529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.341853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.345430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.346232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.348234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.348234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.356347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.357802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:42.369646 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:42.370599 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:42.372138 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 411/812] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:42.374103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.449782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedc2f6-4ec4-4516-b088-212d3ed53249 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.478500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f713-c11a-4d97-bad1-67a946f4f2c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.487588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.488438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.488722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.488995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.489776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.490083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.491446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.501712 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 402/813] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.501712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.518166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.518780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.519061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.519331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.520139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.520443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.521843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.539853 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 412/814] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.540509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.574957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.580454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.612615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b038-b2f3-4443-9869-9e4dd23bb160 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.646832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.647470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.647741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.648051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] PATH_INFO: `/v3/services/network` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.648697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.650046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.657479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b897-6d9c-47fb-81d9-e684f0800953 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:42.659029 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:42.660025 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:42.660855 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 403/815] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:42.661619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.700379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.701664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.701949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.702229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.703017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.703325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.704766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.723863 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 413/816] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.724681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.782057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a340fb-31df-4129-ba1b-1a86f551fe9d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.818749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.820746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.821226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.821579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.821764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.822437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.822738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.824989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.826192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:42.835770 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 404/817] 10.222.0.47 () {56 vars in 1124 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:42.835946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fc3b2-693c-4399-b244-a70308cc0476 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.836044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.872888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.873545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.873828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.874108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.884610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.886478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:42.902836 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:42.903735 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:42.904661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:42.904661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:42.904661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:42.904661 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:42.904661 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 414/818] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:42.905571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:42.953446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c6696-d4c0-4ca1-8969-e82c656efece None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:42.990912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:42.991910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:42.992378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:42.992694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:42.993346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] RBAC: Adding query filter params (name=network) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:42.993657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:42.995028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.004806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 405/819] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:43.004806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.015128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d3fec-fcf4-4880-972d-cfde05061a08 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.050363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.050983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.051266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.051542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.064024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.066080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.111853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff96b55-a54a-4ffb-be53-dd4597524beb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.122731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.124230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.147624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.148276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.148562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.148843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.149545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.150917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.183961 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 406/820] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:05:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:43.183961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.252001 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 415/821] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:43.253039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.303141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.336668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e58-9759-4d79-a09a-479946354f2f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.357371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.375461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c5f77-cf0a-42e9-9425-526573ef5bab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.388153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.388793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.389074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.389354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.390060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:43.390375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.391756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.407691 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 407/822] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:43.412844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.418704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.419449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.419832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.420233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.421021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:43.421429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.422915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.431340 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 416/823] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:43.432054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.544252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba350-5778-48c6-9323-8cc0ce06696d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.548664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8e1f-0e9d-474d-b402-a292dc859a1f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.575340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.586882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.587591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.587882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.588202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.592952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.593705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.594058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.594407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.600127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.601599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.604365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.606556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:43.619417 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:43.620408 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:43.621866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:43.621866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:43.621866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:43.621866 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:43.622094 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:43.623772 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:43.625812 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:43.626794 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 408/824] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:43.626794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.627031 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 417/825] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:43.635986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.664452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.762563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61269e3-558d-468c-854c-bc06aadaf2e8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.766548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0293-cf87-416f-a8e2-f57788231ec2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.800719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.801186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.801467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.801742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.802439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:43.802746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.804052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:43.804186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.804668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.804949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.805224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.805921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:43.807264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d233996-e4c1-4e21-bf8f-a00f32bdd77f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:43.816859 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 418/826] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:43.817686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.832882 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 409/827] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:05:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:43.834337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb642-6fce-4e79-9183-bdc3bedf1c40 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:43.834627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb642-6fce-4e79-9183-bdc3bedf1c40 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:43.835169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdb642-6fce-4e79-9183-bdc3bedf1c40 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:43.840598 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 410/828] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:43.840598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdb642-6fce-4e79-9183-bdc3bedf1c40 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:43.862897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.967819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:43.974077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903ffeb-15ad-47e0-bf50-6587cde83eb7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:43.999463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdb642-6fce-4e79-9183-bdc3bedf1c40 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.021817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.022759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.023051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.023331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.024123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:44.024439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.026333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde9cb6-fed1-493c-8725-3fcd7981c24b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.044058 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 419/829] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:44.045611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.045905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.046185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.047826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.048543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.048828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.049106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.056573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.059403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.071973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:44.075161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:44.075291 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:44.076630 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 411/830] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:44.077511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.156608 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 420/831] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:44.157288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.179523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.202227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925831b-9e83-4113-96f5-c790914d144a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.239341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.240149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.240427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.240706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/4f1f366465294ed69b534136c7daf9fc/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.251778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.259864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=4f1f366465294ed69b534136c7daf9fc, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.261842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.266365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aa77c-ceec-4db0-b638-8eaedbf6e59a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.283958 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 412/832] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:44 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/4f1f366465294ed69b534136c7daf9fc/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:44.283958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.316050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.316716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.317001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.317286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.318092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:44.318405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.319979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.338707 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 421/833] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:44.340805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.427853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d1848-6777-40e4-9455-d4b80e21677c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.435912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.469926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9e21-480c-438c-bbd7-8a1b54f3a41e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.479404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.481039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.481374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.481587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.495184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:44.501270 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:44.502237 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:44.503272 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 413/834] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:44.508813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.525141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.526192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.526728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.527400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.528572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:44.529141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.531065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.538492 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 422/835] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:44.570263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.632626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa20b-9b38-4e03-a9a6-cd6a0e8689f1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.675926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.676581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.676864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.677142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.677924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:44.678236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.679621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.690317 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 414/836] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:44.695980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.809042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c2216-f249-4e1c-a936-893d555a1662 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:44.844120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:44.844683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:44.844964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:44.845236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:44.854990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:44.857278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:44.858745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:44.874020 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:44.874943 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:44.876023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:44.876023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:44.876023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:44.876023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:44.876023 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 423/837] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:44.881024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:44.991284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1411898-4f70-48e7-ac22-4b164c7bb1cb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.003052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.030409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.031096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.031384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.031657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.032465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:45.032774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.034197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.047303 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 415/838] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:45.052916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.162748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd02d3a-dd7a-4a30-9502-c05bb89aa97d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.197274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.197923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.198202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.198474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.206900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.208382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-64b2ee43-7df6-4657-810d-c30c8c96e162 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:45.220650 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:45.222929 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:45.225236 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 424/839] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:45.232269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.335636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84edcdb-cbe3-4b30-a87f-bfe034dd7ae2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.374289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.374913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.375196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.375471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.376297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:45.376606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.378118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.387916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b90b-3f27-461d-8ee4-684dec5dc368 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.388229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b90b-3f27-461d-8ee4-684dec5dc368 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.388515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59b90b-3f27-461d-8ee4-684dec5dc368 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.390156 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 425/840] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:45.395113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.395401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.395681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.397566 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 416/841] 10.222.0.47 () {56 vars in 1135 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:45.403022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.416656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:45.418731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:45.432700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.493096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.519410 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 426/842] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:45.527984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e88e8-4fc8-43c8-b23f-65139c5a9ba6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.541230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.560646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.561269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.561552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.561828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.633487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.634959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.646482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1797f61-8c1e-4bed-ac52-4a41f4dfe91e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.664555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.684328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.685164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.685522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.685892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.686596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.688090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:45.702788 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:45.704251 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:45.705074 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 427/843] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:45.712215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.751019 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 417/844] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:05:45.757251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.776376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.836643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26e41-a1e3-4886-a025-e3a1c3987136 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.874202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.875001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.875387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.875764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.876571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:45.876977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.878501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.883916 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 428/845] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:45.890619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:45.904058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c3e70-f8ec-422e-a687-34cb65f2e4d4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:45.932667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:45.941527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:45.942711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:45.943447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:45.943969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:45.956245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:45.957887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:45.973967 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:45.974916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:45.975803 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:45.975803 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:45.975803 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:45.975803 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:45.975803 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 418/846] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:45.981590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.024540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524213a-df71-46ef-97b4-2778aa1257e7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.037960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.069229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.070438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.070734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.071069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.071768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:46.072170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.074240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.084107 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 429/847] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:46.124996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcead985-8b3a-4296-94ec-c2c5c2e5ac35 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.164294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.165245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.165745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.166215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.167113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:46.167865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.169622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.183894 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 419/848] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:46.189970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.300778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07102a6-21c2-4962-bd29-49af051a8e0e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.335770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.336737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.337224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.337695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.345497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.347249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b06b4b4b-fb90-4c38-8222-d0ac2e73d53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:46.360015 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:46.360933 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:46.361825 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:46.363829 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 430/849] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:46.369964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.414909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.489461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ecea8-a141-4764-8b22-e47b48e22f3a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.499593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb946c-c35f-4a3c-9fda-6d5673082cb9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.499879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb946c-c35f-4a3c-9fda-6d5673082cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.500183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb946c-c35f-4a3c-9fda-6d5673082cb9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.501807 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 431/850] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:46.506830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.507113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.507389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.532455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:46.533664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:46.535839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.536748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.537101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.537455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.538283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:46.538660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.540201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.553977 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 420/851] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:46.562542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.575721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.631846 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 432/852] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:46.655310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.705157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.710505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f4d6c-5ff7-4163-b1d5-62bb95386474 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.756496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.757905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.758387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.759265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.760583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4d58f02ebba84bf0b29ef054b7d8cc8f) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:46.761157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:46.763595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5313-5b54-47cb-b0f3-a14072d2b1bb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:46.772067 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 421/853] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/role_assignments?user.id=4d58f02ebba84bf0b29ef054b7d8cc8f&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:46.774357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a46f-68b8-4aa7-89c4-28f015d2305e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.775112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a46f-68b8-4aa7-89c4-28f015d2305e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.775595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67a46f-68b8-4aa7-89c4-28f015d2305e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.777912 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 422/854] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:46.785841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.786151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.786407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.791388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e6ea0-5980-493c-ad9a-100d6d29098f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:46.807517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:46.809454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:46.833346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:46.834413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:46.835167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:46.835643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:46.848172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:46.853753 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:46.854740 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:05:46.856202 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:46.864057 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 433/855] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:46.865785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:46.896807 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 423/856] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:46.901631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:46.914726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.004312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad0f6e-27c6-4f7f-8a83-9987fe5e5564 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.040014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.047165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.047946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.048343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.048718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.049540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.049947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.050329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1cd3c-577a-4b3f-aab1-596a98f7885e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.051508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.062010 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 434/857] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:47.067896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.094153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.095341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.095778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.096312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.097118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.099258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:47.113494 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:47.114677 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:47.115704 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:47.118409 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 424/858] 10.222.0.47 () {56 vars in 1132 bytes} [Sun Jul 31 01:05:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:47.131979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.181885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.197749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966404bd-162b-4db4-9f20-6e7af313f7dc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.236221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.236972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.237319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.237664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.247169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ebbf-331f-4b59-bf50-0e018919a2c3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.250099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.251638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:47.267199 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:47.268170 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:47.269048 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:47.269048 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:47.269048 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:47.269048 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:47.273092 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 435/859] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:47.274382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.285385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.286194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.286532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.286909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.287622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.287950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.289538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.296506 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 425/860] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:47.305039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.333550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.416458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75862-7b64-47ab-805b-96503f251f29 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.425318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2face-9503-4586-8d58-9f75f0cf2a65 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.463480 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.464156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.465168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.465281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.466043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.466336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.467701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.475135 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.480832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.482470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.482963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.483549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.484466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.484976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.486405 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 436/861] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:47.486855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.487707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.493632 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 426/862] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:47.609575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98b1-c94f-42e3-934a-cbfdf196d500 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.651778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.653374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.653884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.654356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.662954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.664944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:47.678967 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:47.684801 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:47.685784 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 437/863] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:47.688773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.781807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.799440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739e3ed-41c1-430d-b456-73de8ca26b46 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:47.835428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:47.836478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:47.836965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:47.837441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:47.838432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:47.838974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:47.841320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:47.861001 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 427/864] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:47.866951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:47.934570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:47.979120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b68c0-1022-4656-8ba9-5c7936226f81 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.018343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.018976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.019265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.019735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.093650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.095108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3078d-5a60-45c2-9b9f-3bc045fe1454 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.160729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:48.205296 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 438/865] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:48.211347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:48.235839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b07b-d0e9-420a-be6f-8f26922bf677 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.236362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b07b-d0e9-420a-be6f-8f26922bf677 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.236810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23b07b-d0e9-420a-be6f-8f26922bf677 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.238616 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 439/866] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:48.244226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.244730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.245199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.265692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:48.267347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:48.329001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89911aa0-5ac9-4d84-990c-25b25d665eb7 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.363752 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 440/867] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:48.372284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.373197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.373690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.374186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.385887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:48.389186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.390903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.394246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:48.408707 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:48.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:48.410535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:48.410535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:48.410535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:48.410535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:48.412802 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 428/868] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:48.419346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:48.509569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:48.529106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6935c0-27a4-4671-b198-826bc12d4873 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.536341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e920-c08a-4d74-b324-2f85899c2f4e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.572783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.573411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.573818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.574097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.574752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:48.575073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.576465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.578254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.579635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.580179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.580669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.581566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.583126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.595016 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 429/869] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:48.596079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:48.608255 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 441/870] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:05:48 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:05:48.675481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:48.729439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b25e8-9aaa-4adb-8c46-392d76b3ef96 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.781869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.783304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.783813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.784309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.791859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.794185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-09dfeaf7-5e6b-4ee6-9175-20aa091a35b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:48.806031 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:48.807113 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:48.808380 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:48.810493 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 430/871] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:48.816910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:48.925990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db796-d88d-4324-a829-bdb554fde051 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.926601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db796-d88d-4324-a829-bdb554fde051 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.927051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6db796-d88d-4324-a829-bdb554fde051 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.929941 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 431/872] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:48.934379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145027-3d0e-4663-9817-4773402197f2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.934610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b772e3-57a6-4835-a56c-2e8557b54697 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:48.935407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145027-3d0e-4663-9817-4773402197f2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.935982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07145027-3d0e-4663-9817-4773402197f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.955767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-07145027-3d0e-4663-9817-4773402197f2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:48.957393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-07145027-3d0e-4663-9817-4773402197f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:48.970584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:48.971206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:48.971496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:48.971778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:48.972593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:48.972882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:48.974317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:48.994211 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 442/873] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:49.000786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.012660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.044289 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 432/874] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:49.072134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07145027-3d0e-4663-9817-4773402197f2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.113966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a67390-cc8e-4142-9db2-1c8dc6a62b4a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.121410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.155186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.155811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.156128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.156412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.157208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4f1f366465294ed69b534136c7daf9fc) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:49.157526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:49.158976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:49.172239 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 443/875] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:48 2022] GET /identity/v3/role_assignments?user.id=4f1f366465294ed69b534136c7daf9fc&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:49.189841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07145027-3d0e-4663-9817-4773402197f2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.231506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.232265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.232552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.232830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.233521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:49.234936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:49.245121 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:49.246217 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:49.247518 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 433/876] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:49.253418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.334006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.369480 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96d2a-c350-447e-a8ea-2cdea26a476e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.407734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.408398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.408684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.408963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.409662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:49.409972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:49.411364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffbcad7-6e91-4574-ad03-00bbf78f9f34 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:49.416803 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 444/877] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:49.423500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.540176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab813bc-c28a-41e1-b4f9-5c6e6b669287 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.548739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:49.579046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.579667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.579971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.580265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.580940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:49.581246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:49.582676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abd850-4935-4ab1-ad6d-eeda12514d2c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:49.588080 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 434/878] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:49.694124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd4c7-f747-41a6-b280-58013fe08a1c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.694782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd4c7-f747-41a6-b280-58013fe08a1c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.695325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd4c7-f747-41a6-b280-58013fe08a1c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.697288 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 445/879] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:49.703835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0964-7c59-4870-b3d9-f6dac77ed4e3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.704259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0964-7c59-4870-b3d9-f6dac77ed4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.704550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe0964-7c59-4870-b3d9-f6dac77ed4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.724469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f7fe0964-7c59-4870-b3d9-f6dac77ed4e3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:49.725699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f7fe0964-7c59-4870-b3d9-f6dac77ed4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:49.805667 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 435/880] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:49.829688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd4c7-f747-41a6-b280-58013fe08a1c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:49.944857 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd4c7-f747-41a6-b280-58013fe08a1c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:49.982901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:49.983948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:49.984461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:49.984936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:49.985829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:49.987390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6b5e-f7b3-41b6-bde0-458579aaea58 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:49.992006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:50.009520 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 446/881] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:05:49 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:50.766697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59b4c-4714-4b95-84f8-f76f085f3d03 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.766886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59b4c-4714-4b95-84f8-f76f085f3d03 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.767151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59b4c-4714-4b95-84f8-f76f085f3d03 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.768861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 436/882] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:50.774016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:50.774305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:50.774583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:50.793850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:50.795043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:50.873856 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 447/883] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:50.895324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59b4c-4714-4b95-84f8-f76f085f3d03 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.000481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.007989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59b4c-4714-4b95-84f8-f76f085f3d03 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.044632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.045200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.045488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.045768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.046404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.047789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:51.057053 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:51.058651 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:51.059499 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 437/884] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:51.064975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.171055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d52008-8b32-4f24-8354-6e8aa139eb59 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.197544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.210774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.211403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.211690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.212001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.212911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.213404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.215615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.220861 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 448/885] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:51.226611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.335845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8f3d-4e6c-43f0-b88c-291c62cb2df2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.371505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.372148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.372430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.372705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.373374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.373676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.375109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f0524-bdb4-47f6-b966-298c195f57ce None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.384043 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 438/886] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:51.386767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.482396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f099a-ff2e-43c2-a890-052d15e81e63 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.482746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f099a-ff2e-43c2-a890-052d15e81e63 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.482990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f099a-ff2e-43c2-a890-052d15e81e63 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.484629 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 439/887] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:51.489786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.490105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.490359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.496414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e7b1-22de-4014-a15d-8897d1e48f75 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.509493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:51.510718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:51.533205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.534224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.534772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.535255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.536302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] RBAC: Adding query filter params (interface=public, service_id=4183a74c55a84bf2b9f5c45cd29d309a, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.536526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.537024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.538655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.548107 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 449/888] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/endpoints?service_id=4183a74c55a84bf2b9f5c45cd29d309a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:51.558659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.595373 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 440/889] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:51.618790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.632415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.682264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e14cd-900c-47fb-96a4-3ee2d5755707 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.719572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.720227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.720516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.720796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.721459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.722826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b3e2-a553-4a7c-a233-e12c4938ea4c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.723734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fc690-cfb4-457a-8639-313656011ed2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.735969 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 450/890] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:05:51.735969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d485a-382f-420b-a784-a9b82475ed33 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.735969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d485a-382f-420b-a784-a9b82475ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.735969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d485a-382f-420b-a784-a9b82475ed33 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.735969 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 451/891] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:51.739540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.739540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.739540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.758374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:51.759617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:51.777668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.778637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.779090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.779438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.795087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:51.802900 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:51.804115 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:51.805189 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 441/892] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:51.812770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.840126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.844487 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 452/893] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:51.868291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:51.919693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:51.947741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001942d-5e47-4a8b-a421-aea72476e2b9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:51.989230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:51.989885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:51.990166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:51.990442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:51.991164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:51.991471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:51.992874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:51.994597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60ddfd-d0b5-476f-bbe7-f30e02b8e9db None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.003125 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 442/894] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:05:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:52.008998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.036200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.036833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.037119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.037513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.038224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.039720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a2e7e-85d2-40bc-b469-bb8561cf5e6f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.067451 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 453/895] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:05:51 2022] POST /identity/v3/services => generated 241 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:05:52.123063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.147981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbf86-a462-4832-8d8f-08a06b18768e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.148181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36aaa-ce87-4c9c-ac94-ed8cff0185b3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.148260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbf86-a462-4832-8d8f-08a06b18768e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.148575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efbf86-a462-4832-8d8f-08a06b18768e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.150247 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 454/896] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:52.156901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.157205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.157453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.177882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:52.179138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:52.203641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.204470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.204754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.205154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.218772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.220396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:52.238712 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:52.239657 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:52.240554 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:52.240554 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:52.240554 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:52.240554 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:52.242814 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 443/897] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:52.249143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.275267 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 455/898] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:52.306330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.353548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.377954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35dd2c-52e5-4a0b-93a6-178c2ee70505 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.406649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.418381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.419223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.420596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.420985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.422063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:52.422478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.424729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.429638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41b75-8de2-419f-94b9-9c846df912d4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.445778 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 444/899] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:52.447373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.484173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.485460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.486122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.486623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.488040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.489694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:52.501742 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:52.502750 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:52.503593 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:52.505990 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 456/900] 10.222.0.47 () {56 vars in 1132 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:52.515320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.585591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5bffc-b129-4116-ae72-44e3ad81aab9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.634674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.635240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.635522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.635794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.643553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.645044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.657039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585f403-8a8b-441c-a678-d7a0342c4191 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:52.657763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:52.658864 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:52.659997 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:52.662104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.663904 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 445/901] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:52.664783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.705987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.707009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.707517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.708028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.708931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:52.709830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.712119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.719099 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 457/902] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:52.724764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.728017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:52.793555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35007-a924-4c91-85e8-7625b7e356cb None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.835587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e4712-253a-4625-8032-32cc7567cbe0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:52.839144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.840066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.840575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.841052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.842057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:52.842581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.845129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.876292 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 446/903] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:52.877231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.878590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:52.879562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:52.880390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:52.881831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:52.882738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:52.883262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:52.884933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:52.892593 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 458/904] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:52.898195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:52.938291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.002293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf1d1-a25c-4db9-ac38-2fde8c16780a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.011769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.028694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092d302-1757-4c1c-81a7-2d54a6c3f703 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.043911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.044868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.045456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.045936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.065691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.066764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.067234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.067698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.068644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] RBAC: Adding query filter params (interface=public, service_id=e70e6d23c17a4c49adafc4770baa5fb9, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:53.068958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.070420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.080586 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 459/905] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/endpoints?service_id=e70e6d23c17a4c49adafc4770baa5fb9&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:53.083216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.125273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.127076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.184416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.193894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337adb-ab98-45dd-9c6f-cb7ca09c40b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.232404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.233113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.233401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.233678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.234334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.236707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.239870 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 447/906] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:05:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:05:53.246019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.248658 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 460/907] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:05:53.263124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.374542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29db61-88d0-47c9-b08e-9ccd82dbdc21 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.414553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.415576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.416105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.416627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.435186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.436691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:53.453978 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:53.454948 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:53.455826 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:53.455826 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:53.455826 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:53.455826 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:53.455826 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 448/908] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:53.461354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.574789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1b8b6-6af4-4d83-9572-8a502e71ffb5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.610896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.611833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.612327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.612747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.613581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:53.614033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.615558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.628510 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 461/909] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:53.634209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.699759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.743039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f8975-8a3d-459c-a036-1c0f67a8b058 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.779859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.780626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.780979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.781315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.788555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.790077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8eacf431-d4b3-4464-8ae6-37daf2f3f4e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:53.802114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:53.802999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:53.804032 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 449/910] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:53.811617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.828996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:53.882495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864066bd-fd4a-407d-ab2b-07a224c15f49 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.882819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864066bd-fd4a-407d-ab2b-07a224c15f49 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.883064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864066bd-fd4a-407d-ab2b-07a224c15f49 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.888060 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 450/911] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:53.890584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.890873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.891158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.910556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:53.911752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:53.923406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcef92-de03-4f31-8663-d02592bc81d7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:53.961366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:53.962215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:53.962717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:53.963405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:53.965097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:53.965651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:53.967339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:53.981053 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 462/912] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:53.991610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:53.992079 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 451/913] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:54.009599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.067296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.099061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.130884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521f7a2-5f6e-4ba8-9b0b-277f173d191c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.131137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c919a0f-da4e-40d4-9b9f-9704fe4fd4e7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.168580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.169394 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.169766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.170132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.170691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.171109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] RBAC: Adding query filter params (role.id=7bd9c281b7094184893aa3dde43ff4ae, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4f1f366465294ed69b534136c7daf9fc) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.171513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.171802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.172468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.173114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.173346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.174527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.176819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.179970 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 463/914] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:05:53 2022] GET /identity/v3/role_assignments?user.id=4f1f366465294ed69b534136c7daf9fc&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=7bd9c281b7094184893aa3dde43ff4ae => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4fdf41c4-a7b7-4d9c-8738-0a49edc8f114 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:54.191916 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:54.193205 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 31 01:05:54.194051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:54.202517 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 452/915] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:54.204632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.241732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451bc2-cce0-4bf7-86b6-e704daa0c4bf None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.242031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451bc2-cce0-4bf7-86b6-e704daa0c4bf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.242218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451bc2-cce0-4bf7-86b6-e704daa0c4bf None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.243800 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 453/916] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:54.250183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.250506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.250726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.275198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:54.276865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:54.329491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7661c7-7ec0-429e-b3b6-6bdc3a90dbda None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.379968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.379968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.379968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.379968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.380371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.380371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.380889 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 454/917] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:54.381138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.387254 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 464/918] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.392872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.399046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.402525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.454807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.529050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7898c-63d6-412b-a474-d765a82d0777 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.535434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f268-18d8-4dc5-bab6-07eab7105df8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.575563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.576621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.577057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.577609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.578174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.578566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.578989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.579362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.579728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.580545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.580837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.581037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.582595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:54.592782 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:54.593778 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:54.594602 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:54.595317 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 455/919] 10.222.0.47 () {56 vars in 1114 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.596282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.602467 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 465/920] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:54.603610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.685402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.716822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688506a-8ca2-4050-867d-09e2638e9de2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.725776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:54.738753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b14530-ac0b-470f-ab18-1472705399c7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.755840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.756804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.757350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.757886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.758789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.760408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.781008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42555-498b-40f3-8066-b377684818bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.781564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42555-498b-40f3-8066-b377684818bd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.781962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42555-498b-40f3-8066-b377684818bd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.782242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b42555-498b-40f3-8066-b377684818bd None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.783057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42555-498b-40f3-8066-b377684818bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.783367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42555-498b-40f3-8066-b377684818bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.784831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b42555-498b-40f3-8066-b377684818bd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.785847 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 456/921] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:05:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:05:54.802316 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 466/922] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.809325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:54.939017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426010c-c675-40cc-b732-62dc8765ee10 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:54.976594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:54.977608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:54.978199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:54.978481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:54.979198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:54.979510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:54.981825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:54.987865 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 457/923] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:54.993520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42555-498b-40f3-8066-b377684818bd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.100586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b42555-498b-40f3-8066-b377684818bd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.130666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.137288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.138343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.139014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.139525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.140709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] RBAC: Adding query filter params (interface=public, service_id=3400c9465c57443aa7e186bc8481e5a3, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:55.141073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.142502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b882b-18bd-446e-b1b1-6bd2cc3dd2a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.148281 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 467/924] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:05:54 2022] GET /identity/v3/endpoints?service_id=3400c9465c57443aa7e186bc8481e5a3&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:55.154022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.182410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.263574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10684f18-f9fd-4ff8-a7ad-10e692f6959e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.298739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.299362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.299643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.299918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.300590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.301963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b36df-516e-439f-aa0b-7408f87df727 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.309027 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 458/925] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:05:55.491616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183465-c485-4a6e-adc4-3f9b8a476653 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.492035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183465-c485-4a6e-adc4-3f9b8a476653 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.492211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35183465-c485-4a6e-adc4-3f9b8a476653 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.493827 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 468/926] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:55.499836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.500158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.500435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.523877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:55.525083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:55.595499 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 459/927] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:55.619070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183465-c485-4a6e-adc4-3f9b8a476653 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.741810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35183465-c485-4a6e-adc4-3f9b8a476653 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.779494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.780177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.780460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.780746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.781381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.782823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:55.793951 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:55.794890 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 31 01:05:55.795718 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:55.798663 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 469/928] 10.222.0.47 () {56 vars in 1132 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:55.804906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:55.824343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:55.911835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26dd58-5d22-473c-8e2b-9db61b863053 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:55.952553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:55.953225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:55.953513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:55.953787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:55.954516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:55.954821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:55.956215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:55.961798 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 460/929] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:55.968102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.031724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.075783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a4658-f107-4cde-b2c0-3d4142dd3ab8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.114801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.115433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.115706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.116013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.116714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:56.117021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.118399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2abb-0cbe-450e-b8c5-bdcf80691d6f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.124742 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 470/930] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:56.130336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.216576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.240372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7573b9-281a-44a1-b114-3f6fccac6ba6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.277333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.277938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.278223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.278502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.279214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.280611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.296323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7631-6168-47bf-be66-6efea6e43b6d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.296604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7631-6168-47bf-be66-6efea6e43b6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.296816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7631-6168-47bf-be66-6efea6e43b6d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.298225 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 471/931] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:56.304694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.304996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.305288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.305994 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 461/932] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:05:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:05:56.326205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:56.327554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:56.417302 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 472/933] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:56.450476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.561452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b982056-99e4-4150-a87d-e6e2359b5006 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.595998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.596648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.596925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.597201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.599921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.609663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:05:56.614683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:56.615615 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:05:56.616489 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:56.620038 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 462/934] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:05:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:56.622908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.672622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:56.725303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c690f9-717e-42d7-910d-c5e760a97510 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.762363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.762986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.763265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.763541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.764361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:56.764667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.766030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.774653 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 473/935] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:05:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:56.781379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:56.890464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f80cf-2456-4f62-892a-efd133fb3186 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:56.927388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:56.928075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:56.928458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:56.928742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:56.940795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:56.942247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0790c0d2-08e5-49df-9ba9-aacd66cbe452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:56.957340 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:56.958249 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:56.960351 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:56.960351 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:56.960351 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:56.960351 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:56.960351 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 463/936] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:56.965896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.068130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d171881-e21a-4500-9dfb-efd78af293d6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.079741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.098552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610424-5c3e-4fcc-9183-6eb2f3a5ec0e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.099166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610424-5c3e-4fcc-9183-6eb2f3a5ec0e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.099743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64610424-5c3e-4fcc-9183-6eb2f3a5ec0e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.101659 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 464/937] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:05:57.105691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.106495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.106777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.107047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.107731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:57.108059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.108652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.109131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.109415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.109814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.127058 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 474/938] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:57.128344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.129752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:57.131311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:57.197318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.237997 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 465/939] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:05:57.257188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d950e59-1278-49ed-a6fa-09f77a1759ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.260798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.302820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.303812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.304314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.304882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.313860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.315557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:05:57.328474 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:57.329413 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:05:57.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:57.332952 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 475/940] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:57.343986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.365749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a982db5-0c7c-49d0-8e3e-0695a68d9640 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.385167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.409584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.410631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.410919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.411467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.412187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.414382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.418361 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING keystone.server.flask.common [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 01:05:57.444055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.sql.core [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:05:57.444055 dv-cinder-master-3-smb devstack@keystone.service[80453]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:05:57.444055 dv-cinder-master-3-smb devstack@keystone.service[80453]: [parameters: {'id': '6833af8c84cc4c9da730cbd1234b8857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:05:57.444055 dv-cinder-master-3-smb devstack@keystone.service[80453]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80453) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-336a511e-4358-4e78-91fc-df3ff19bea39 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6833af8c84cc4c9da730cbd1234b8857.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6833af8c84cc4c9da730cbd1234b8857. Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:05:57.453770 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result.read() Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 31 01:05:57.454596 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application yield resource Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise self.value Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application session.commit() Jul 31 01:05:57.455592 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:05:57.456994 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:05:57.457871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application result.read() Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:05:57.458655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [parameters: {'id': '6833af8c84cc4c9da730cbd1234b8857', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.459514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:57.462022 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6833af8c84cc4c9da730cbd1234b8857. Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 466/941] 10.222.0.47 () {60 vars in 1140 bytes} [Sun Jul 31 01:05:57 2022] POST /identity/v3/projects => generated 262 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba304ad-54a3-4c73-8777-84c7c0e5d7bc None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.463650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba304ad-54a3-4c73-8777-84c7c0e5d7bc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.468274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba304ad-54a3-4c73-8777-84c7c0e5d7bc None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.468349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608d4f0-4475-48b8-ae71-1312f23f820a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.468439 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 467/942] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:57.468439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba304ad-54a3-4c73-8777-84c7c0e5d7bc None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.499843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.500619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.500998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.501345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.502211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:57.502600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.504065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d2eba-1b41-4b03-8aa8-03b559ab9604 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.511681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.527573 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 476/943] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:57.527573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.527573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.527573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.543787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:57.544951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:57.597590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba304ad-54a3-4c73-8777-84c7c0e5d7bc None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.616229 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 477/944] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:57.616899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.637901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.646527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.647317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.647602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.647877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.655813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.657469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:57.670256 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:57.671141 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.672030 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 468/945] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:57.672901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.734800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564410b-1ac6-4cb8-bdbb-43337841f1fc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.772277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.772913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.773190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.773603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.775891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.782836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d085d2-fb6e-4562-84aa-1f324da90f7c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.785025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.787260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:05:57.804488 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:57.805374 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:57.806236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:05:57.806236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:05:57.806236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:05:57.806236 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:05:57.806236 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 478/946] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:57.806514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.821930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.822776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.822913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.823117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.824557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.825867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:57.834954 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:57.836693 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:05:57.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:57.841890 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 469/947] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:57.842677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.890653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:57.924458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413baaf-e77e-4fc8-af0f-874fd0310774 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.954029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e027c-0e77-446c-a029-d5294e5c8caf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:57.959544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.960457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.960748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.961030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.961725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:57.962035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.963465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:57.981593 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 479/948] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:57.985110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:57.990678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:57.991726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:57.992251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:57.992860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:57.993816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:57.994362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:57.996633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.013214 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 470/949] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:58.018521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.041604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.138322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e869940-cda8-4c96-933f-7ed545237b57 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.144920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ac62b-deb9-4f8a-9220-5b5a98227425 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.176226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.182447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.183826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.184449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.184757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.185743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:58.186056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.188631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.192602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.193354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.193674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.193956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.194377 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 480/950] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:58.200335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.208931 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.210583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:05:58.223188 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:58.224197 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:58.225087 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 471/951] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:05:58.233384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.324795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4951a8-8577-4434-aecf-12eecbd8852f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.331420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.356050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba02c3-c639-4503-bf03-f055c9645ccf None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.362799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.364195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.364742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.365231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.366124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:58.366669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.368715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.379701 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 481/952] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:58.382152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.394483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.394855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.395134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.395412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.396253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:58.396560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.398159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.416395 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 472/953] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:05:58.418281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.458699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.504058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366c29-457a-413f-89f9-7675b8a1f21b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.531097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e8677-6d90-437d-b706-925ce849ea41 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.540388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.541019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.541302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.541585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.542293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.543819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9c22-eba9-469a-b74a-1c30a4e75e6e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.576042 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 482/954] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:05:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:05:58.576042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de4f-01cf-4b06-9783-725b1651e55d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.576042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de4f-01cf-4b06-9783-725b1651e55d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.576042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7de4f-01cf-4b06-9783-725b1651e55d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.576042 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 483/955] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:05:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:05:58.579625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.580043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.580436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.586882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.588146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.588598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.590718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/4f1f366465294ed69b534136c7daf9fc/roles/7bd9c281b7094184893aa3dde43ff4ae` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.593595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=4f1f366465294ed69b534136c7daf9fc, role_id=7bd9c281b7094184893aa3dde43ff4ae)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.595271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.599010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:58.605470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:05:58.606817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:05:58.615623 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 473/956] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:05:58 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/4f1f366465294ed69b534136c7daf9fc/roles/7bd9c281b7094184893aa3dde43ff4ae => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:05:58.704608 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 484/957] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:05:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:05:58.728209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.841999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092cef9-1dd7-47dd-9b9d-5c33a13d66d4 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:58.879693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:58.880379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:58.880663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:58.880937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:58.881564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:58.882932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:05:58.892533 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:05:58.893702 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:05:58.894614 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 474/958] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:05:58.900075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:58.947836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.008357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9e705-2e7d-4038-b519-be44bfcfe9ca None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.045161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.045785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.046070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.046349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.047028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:59.047335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.048730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143f39-904f-4317-b33e-a90164c3775d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.053800 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 485/959] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:05:59.059964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:05:59.124238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:05:59.171034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa850e-a5d2-4601-b2de-57177a144ac1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:05:59.206385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:05:59.207058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:05:59.207348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:05:59.207625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:05:59.208347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:05:59.208652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:05:59.210027 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfd022-f8e4-41e2-bb29-31446dde10f6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:05:59.216094 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 475/960] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:05:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:00.196310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd0fb-78d6-4a76-ba19-7ca61f2320d0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.196837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd0fb-78d6-4a76-ba19-7ca61f2320d0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.196917 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bd0fb-78d6-4a76-ba19-7ca61f2320d0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.198996 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 486/961] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:00.204481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.204889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.205079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.225035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:00.226564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:00.299560 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 476/962] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:00.324582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd0fb-78d6-4a76-ba19-7ca61f2320d0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.436033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bd0fb-78d6-4a76-ba19-7ca61f2320d0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.446303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.473906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.474453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.474739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.475016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.475707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.477182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.479757 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING keystone.server.flask.common [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 31 01:06:00.494436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.sql.core [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:06:00.494436 dv-cinder-master-3-smb devstack@keystone.service[80452]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:06:00.494436 dv-cinder-master-3-smb devstack@keystone.service[80452]: [parameters: {'user_id': '913f314e8dd84707a46408bc78a4dab5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:06:00.494436 dv-cinder-master-3-smb devstack@keystone.service[80452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 31 01:06:00.512135 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:06:00.514267 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application yield resource Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.rollback() Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.force_reraise() Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise self.value Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application session.commit() Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 31 01:06:00.516573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._prepare_impl() Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.flush() Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._flush(objects) Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application compat.raise_( Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application flush_context.execute() Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rec.execute(self) Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 31 01:06:00.518714 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 31 01:06:00.520909 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 31 01:06:00.522952 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [parameters: {'user_id': '913f314e8dd84707a46408bc78a4dab5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:00.533604 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 31 01:06:00.535455 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:00.537720 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 487/963] 10.222.0.47 () {60 vars in 1131 bytes} [Sun Jul 31 01:06:00 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:00.538633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.593128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.629023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ad8cb-a9c2-4db0-b475-b92e61ec46df None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.665509 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.666159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.666446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.666729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.674462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.675983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-58a75d6b-469f-4616-beef-ce0b31ab263f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:00.689558 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:00.691724 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:00.693996 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 477/964] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:00.698113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.771993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3a8d-de5e-4044-b043-0c243852e181 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.771993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3a8d-de5e-4044-b043-0c243852e181 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.771993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3a8d-de5e-4044-b043-0c243852e181 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.775023 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 478/965] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:00.783966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d889b1-504f-4246-a5b8-c8be117f7801 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.783966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d889b1-504f-4246-a5b8-c8be117f7801 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.783966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d889b1-504f-4246-a5b8-c8be117f7801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.803184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-93d889b1-504f-4246-a5b8-c8be117f7801 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:00.804424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-93d889b1-504f-4246-a5b8-c8be117f7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:00.817837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9d541-212a-4442-8938-e77db59e17a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:00.860641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:00.861498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.861628 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.861830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.862582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:00.862892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:00.865061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:00.879568 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 479/966] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:00.881879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19aae9-3d5e-43ac-8d8f-e82429bf4ba2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.882436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19aae9-3d5e-43ac-8d8f-e82429bf4ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.882934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19aae9-3d5e-43ac-8d8f-e82429bf4ba2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.890520 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 480/967] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:00.892141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:00.892631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:00.893109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:00.905730 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 488/968] 10.222.0.47 () {56 vars in 1101 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:00.906586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:00.918868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:00.920725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:00.945316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:00.996501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.029006 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 481/969] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:01.044480 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a819ac0-c856-4180-95ac-ac4fc31d36cf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.047774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.088793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.089878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.090381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.090873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.091540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.092937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:01.102339 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:01.103348 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:01.104261 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 489/970] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:06:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:01.110218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.192017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb66e8b-e7c3-4536-b0b1-161b178e2ef8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.226168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.230722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.231436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.231732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.232050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.237501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9020e-d425-4625-b010-a61d563c0b91 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.242507 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:01.248067 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:01.249043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:01.250655 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 482/971] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:01.254944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.275688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.276446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.276771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.277046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.277716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:01.278027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.279461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.284518 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 490/972] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:01.290056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.291983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.362117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b51c1-00a3-476c-8f01-089079239c72 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.390850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453719e-29ba-44a0-9813-e8936b2c5bc0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.395116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.395736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.396057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.396338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.397053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:01.397368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.398738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0086f4-3272-496f-a8a5-271790b9c776 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.407830 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 483/973] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:01.407830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d1b-2962-4aaa-99d3-1b742e6aad00 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.407830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d1b-2962-4aaa-99d3-1b742e6aad00 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.407830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea78d1b-2962-4aaa-99d3-1b742e6aad00 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.407830 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 484/974] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:01.413273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78d1b-2962-4aaa-99d3-1b742e6aad00 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.429078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.429722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.430004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.430277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.430957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:01.431259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.432642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965f125-13b4-497c-b9c4-5e61cc6e9648 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.442745 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 491/975] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:01.442745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.442745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.442745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.459597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:01.461459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:01.475399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.512615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.521124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea78d1b-2962-4aaa-99d3-1b742e6aad00 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.527691 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 492/976] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:01.528555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.556262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.556829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.557110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.557381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.569141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.570572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:01.585387 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:01.586341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 485/977] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:01.587325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.635651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f4293-8700-49e4-88f4-d6de9e42456f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.670818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.671430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.671709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.672010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.672767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] RBAC: Adding query filter params (interface=admin, service_id=3400c9465c57443aa7e186bc8481e5a3, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:01.673075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.674426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.679818 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 493/978] 10.222.0.47 () {56 vars in 1249 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/endpoints?service_id=3400c9465c57443aa7e186bc8481e5a3&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:01.680619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.686768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd12e3-6589-4977-9c1c-4f9e36cbea7e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.696681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.721400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.722008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.722288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.722561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.723241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.724635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.738713 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 486/979] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:01 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:01.739581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.755772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.789047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0f345-4892-4719-abcc-d2a2cb17ecf7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.835769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.836435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.836713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.836987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.837687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:01.837993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.840061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.852561 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 494/980] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:01.857985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:01.870328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741686-b9fc-471f-9da5-2b5f6a547b8e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:01.915658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:01.916329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:01.917189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:01.917189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:01.917694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:01.919074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:01.926385 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 487/981] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/services => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:06:01.936854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:01.974849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717106d8-c41d-4855-b8be-8428041a01a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.014374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.015039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.015323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.015600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.024546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.026020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:02.039245 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:02.040380 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:02.041319 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 495/982] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:06:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:02.047441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:02.125940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.159273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77e77b-b960-469b-bec6-84691511ff8f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.194453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.195079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.195364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.195642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.196466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:02.196777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.198201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.217859 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 488/983] 10.222.0.47 () {56 vars in 1149 bytes} [Sun Jul 31 01:06:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:02.223295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:02.330201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff98b-173a-450d-9c3f-c300cb7c31fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.358157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.364889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.365507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.365786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.366060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.438898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.443154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.543876 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 496/984] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:02 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:02.549757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:02.653366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf3e7f-fe5b-4f03-b48d-247513fc6ab2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.679285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.688325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.689027 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.689261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.689543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.700422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.701872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:02.717672 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:02.718541 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:02.719460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:02.719460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:02.719460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:02.719460 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:02.720250 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 489/985] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:02.724474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:02.755249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:02.827236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbd360-3282-40ea-961b-bb09b196e513 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:02.860850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:02.861464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:02.861744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:02.862017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:02.862700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:02.863008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:02.864401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:02.878779 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 497/986] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:02.884312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:02.990650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceddcb8-eb65-4514-adca-aefd9054f8b6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.025260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.025906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.026192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.026518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.033423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.034868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:03.046535 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:03.047498 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:03.048432 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:03.049520 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 490/987] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:03.053804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.148003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.159438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975db17-44e5-4594-a85c-80a0c146b6dc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.193012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.193630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.193909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.194183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.194921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:03.195228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.196663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1d342-444f-452f-ada6-c2c4d08382f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.214548 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 498/988] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:03.215784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.260198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:03.322189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94db9-8f09-419a-884b-00fd676e8f13 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:03.356379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:03.356994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.357283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.357562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.358349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] RBAC: Adding query filter params (role.id=7bd9c281b7094184893aa3dde43ff4ae, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=4f1f366465294ed69b534136c7daf9fc) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:03.358663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:03.360126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917373-b949-4b76-ad20-d72265239a1e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:03.366226 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 491/989] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/role_assignments?user.id=4f1f366465294ed69b534136c7daf9fc&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=7bd9c281b7094184893aa3dde43ff4ae => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:03.830919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cace3e-3359-44ac-b233-f05a66e82d8b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.831472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cace3e-3359-44ac-b233-f05a66e82d8b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.831472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cace3e-3359-44ac-b233-f05a66e82d8b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.833009 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 499/990] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:03.839587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b410-403c-4b6e-820c-0cb3b6941548 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.840069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b410-403c-4b6e-820c-0cb3b6941548 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.840267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b410-403c-4b6e-820c-0cb3b6941548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.859018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8b84b410-403c-4b6e-820c-0cb3b6941548 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:03.860263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8b84b410-403c-4b6e-820c-0cb3b6941548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:03.928993 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 492/991] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:03.952635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cace3e-3359-44ac-b233-f05a66e82d8b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:03.970330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e44a-bda8-43f0-8cc7-64edd8a76538 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.970626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e44a-bda8-43f0-8cc7-64edd8a76538 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.970909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e44a-bda8-43f0-8cc7-64edd8a76538 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.972423 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 493/992] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:03.977077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:03.977369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:03.977651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:03.996968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:03.998174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:04.025391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.065683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cace3e-3359-44ac-b233-f05a66e82d8b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.068650 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 494/993] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:04.092590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.107055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.107703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.108008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.108284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.108904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.110265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:04.120084 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:04.121840 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:04.123508 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 500/994] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:04.127872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.144876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.207359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde5c92-f3c6-4dd5-8f73-5d8fe6169d24 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.235971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296c1f4-5376-466e-920c-1dfd3cea1d35 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.249093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.250109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.250364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.250556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.251180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.252575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:04.261379 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:04.262370 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:04.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 495/995] 10.222.0.47 () {56 vars in 1126 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:04.274982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.283369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.283999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.284296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.284570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.285242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.285544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.286906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.297478 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 501/996] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:04.298860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.305927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.381676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.384803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deee85c-d08e-4db8-86fc-57fedef826ff None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.408223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215307-4d97-49f7-8cd3-78df4922182d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.420622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d7717-88d6-435c-96b3-954991459013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.421238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7717-88d6-435c-96b3-954991459013 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.421521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7717-88d6-435c-96b3-954991459013 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.421795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7717-88d6-435c-96b3-954991459013 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.422477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d7717-88d6-435c-96b3-954991459013 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.422781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d7717-88d6-435c-96b3-954991459013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.424164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d7717-88d6-435c-96b3-954991459013 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.432011 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 496/997] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:04.437678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d7717-88d6-435c-96b3-954991459013 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.450363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.450810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.451092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.451366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.452077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.452382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.453746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.463829 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 502/998] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:04.465983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.539873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.549357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d7717-88d6-435c-96b3-954991459013 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.574657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d4fae-4873-40ce-b236-a172e0769098 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.585474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.586320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.586752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.587024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.587694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.588028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.590171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.597760 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 497/999] 10.222.0.47 () {56 vars in 1122 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:04.603292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.618248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.618871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.619161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.619442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.620783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] RBAC: Adding query filter params (interface=public, service_id=af52be2c0e31459497d3d544337f8367, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:04.621207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.622570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.628108 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 503/1000] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/endpoints?service_id=af52be2c0e31459497d3d544337f8367&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:04.633179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:04.643445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:04.711520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5fdc9-6cdf-4627-810a-691eb856a586 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.743005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def5fc-c170-467a-a98f-e79b96f51f1a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:04.748129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.748825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.749117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.749395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.750103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.751470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931688d8-494b-48be-be6c-2f92ac2ee77b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.768675 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 498/1001] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:06:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:06:04.786779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:04.787420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:04.787705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:04.788013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:04.788688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:04.790092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43b209-8e69-4b28-b0a7-0af08dd66bde None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:04.798338 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 504/1002] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:06:04 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:06:05.434585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733e9e-240a-446e-9376-b00ef34f4341 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.435105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733e9e-240a-446e-9376-b00ef34f4341 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.435182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e733e9e-240a-446e-9376-b00ef34f4341 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.436739 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 499/1003] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:05.444945 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.445871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.446228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.465658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:05.466855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:05.527661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.536731 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 505/1004] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:05.559644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733e9e-240a-446e-9376-b00ef34f4341 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.578941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.663121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e733e9e-240a-446e-9376-b00ef34f4341 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.696811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.697384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.697666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.697942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] PATH_INFO: `/v3/services/image` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.699245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:05.700677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:05.709393 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:05.710655 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:05.711477 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:05.716248 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 500/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:05.720875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.818710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5607f-52ba-402a-ba56-17d493776515 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:05.853984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:05.854634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:05.854916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:05.855191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:05.856009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:05.856318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:05.857674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aed50-1d01-4371-bb5d-c45bcbf69e21 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:05.867444 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 506/1006] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:05.868387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:05.957594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:05.978323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2ca21-6ff5-4f22-a596-ccbd58ee827e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:06.013439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:06.014053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:06.014333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:06.014602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:06.015266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] RBAC: Adding query filter params (type=image) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:06.015567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:06.016957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013dff-1a7e-4412-a40e-ad3b3bdd24df None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:06.021631 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 501/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:07.001198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1cfa-0f03-4f08-9e18-d98caa627cf1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.001750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1cfa-0f03-4f08-9e18-d98caa627cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.001750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1cfa-0f03-4f08-9e18-d98caa627cf1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.003474 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 507/1008] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:07.008151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d8a-5b85-48a6-b428-2bb2d0eca10f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.008608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d8a-5b85-48a6-b428-2bb2d0eca10f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.008718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9056d8a-5b85-48a6-b428-2bb2d0eca10f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.010074 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 502/1009] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:07.010549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.011372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.011658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.016360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.016939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.017427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.032100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:07.033313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.038128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:07.039552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:07.096735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.110012 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 508/1010] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:07.116477 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 503/1011] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:07.131504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.139617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.218405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.241395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b736913-636e-48e8-8819-25a1d9ebd1e8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.248281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94da5d5-4a33-4065-8d41-a65237007e0e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.280182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.280746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.281035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.281317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.281994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.283331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.287646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.288327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.288632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.288909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.290058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.291487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:07.292789 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:07.293767 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 31 01:06:07.294603 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:07.295433 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 504/1012] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:07.303598 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 509/1013] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:07.303756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.304533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.364764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.410466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a549fc-4a40-46b4-b814-5b0fa6e1d3f1 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.419775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7f35e-43df-4b46-85d8-ec1fef900411 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.455130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.455753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.456068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.456347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.456935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.457071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.457555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.457840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.458116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.458456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.458792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:07.459098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.460760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.471533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 510/1014] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:07.472443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.474296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.490789 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 505/1015] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:06:07.595427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69538e-35c0-4f4a-8f1d-fb9834f5d1bf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.614072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:07.635105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.635773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.636653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.636936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.637634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:07.637941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.639333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c2bd0-c399-4620-a5ba-534fc0d06e89 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.649605 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 511/1016] 10.222.0.47 () {56 vars in 1112 bytes} [Sun Jul 31 01:06:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:07.650701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:07.759767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f6dc-ad39-43c6-b540-f280d64f0673 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:07.797155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:07.798185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:07.798631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:07.799055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:07.799918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:07.801456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65277563-85d9-4eeb-9c98-f45e66a10cd7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:07.823186 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 506/1017] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:06:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:08.140317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688649e-2bdc-43cd-b7d7-85873f634039 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.140828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688649e-2bdc-43cd-b7d7-85873f634039 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.140905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688649e-2bdc-43cd-b7d7-85873f634039 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.142338 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 512/1018] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:08.147389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8ebb-9ca8-4579-8b1a-06ff54b66791 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.147813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8ebb-9ca8-4579-8b1a-06ff54b66791 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.148031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf8ebb-9ca8-4579-8b1a-06ff54b66791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.166767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-25bf8ebb-9ca8-4579-8b1a-06ff54b66791 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:08.168553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-25bf8ebb-9ca8-4579-8b1a-06ff54b66791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:08.215855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:08.246564 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 507/1019] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:08.268491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688649e-2bdc-43cd-b7d7-85873f634039 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:08.373941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688649e-2bdc-43cd-b7d7-85873f634039 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:08.409342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:08.409874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:08.410153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:08.410421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:08.411106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:08.412563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e89deb1-e436-4d8d-96dc-662bb75379ce None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:08.442674 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 513/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:08 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:09.613365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245469-d581-475d-a88d-ac49551ca74c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.613879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245469-d581-475d-a88d-ac49551ca74c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.613956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b245469-d581-475d-a88d-ac49551ca74c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.615433 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 508/1021] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:09.620465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.620907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.621025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.638921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:09.640142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:09.678222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:09.720386 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 514/1022] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:09.744980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245469-d581-475d-a88d-ac49551ca74c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.848513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b245469-d581-475d-a88d-ac49551ca74c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:09.883808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:09.884486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:09.884773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:09.885051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:09.886891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:09.888915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d150062-eb2c-4aae-84b7-2b8c85808bae None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:09.890128 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 509/1023] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:09.895663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:09.998156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed902d-93a0-4d14-8b2a-ab16f5501211 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.002053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe109de-ebab-4064-b1f4-040e219253ed None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.002343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe109de-ebab-4064-b1f4-040e219253ed None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.002621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe109de-ebab-4064-b1f4-040e219253ed None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.004157 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 510/1024] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:10.008929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.009220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.009559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.028353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:10.029556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:10.035692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.036347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.036633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.036937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.037702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.039258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.075964 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 515/1025] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:06:09 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:10.078246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.113880 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 511/1026] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:10.139955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.169497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.255458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf7d8-1ab9-4dda-a5d4-5143288cde34 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.294245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.294906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.295195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.295481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.312524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d37b904c-abc3-4377-9751-bf6c062bd6d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:10.318035 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:10.319010 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:10.320148 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 516/1027] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:10.325319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.426440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1788e6d-1279-4abc-b1a0-2a482e3dc175 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.456322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79f2f1-4fab-4ce1-b5f0-50ceacf01f92 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.456620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79f2f1-4fab-4ce1-b5f0-50ceacf01f92 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.456886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79f2f1-4fab-4ce1-b5f0-50ceacf01f92 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.458231 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 517/1028] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:10.463231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.463514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.464408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.468926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.469542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.469822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.470093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.470802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:10.471102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.472554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.485984 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 512/1029] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:10.486162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:10.486162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:10.486973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.524346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.560581 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 518/1030] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:10.584184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.597434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14fdbd-3173-4059-868e-da337268e70d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.600808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.637999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.638687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.638915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.639185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.650031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.652060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:10.667583 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:10.668629 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:10.669645 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:10.669645 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:10.669645 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:10.669645 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:10.671142 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 513/1031] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:10.676669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.693342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d1d0-5670-49fb-9088-854b14a548e0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.729389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.730595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.730866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.731140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.731763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.733152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:10.742572 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:10.743553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:10.744490 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 519/1032] 10.222.0.47 () {56 vars in 1105 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:10.750216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.773165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.787503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acc81-a0b9-488a-8a0c-8cf7ad8bdff2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.823695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.824326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.824610 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.824881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.825570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:10.825873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.827238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.833158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:10.845886 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 514/1033] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:10.846968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.861377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1fa1-25b9-46b0-96cc-e4d04deea11b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.896523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.897148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.897433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.897718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:10.898403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:10.898714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:10.900111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:10.905334 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 520/1034] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:10.910915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:10.959178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bafcc-ac69-4c54-89be-9c6bbdcb61db None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:10.996579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:10.997440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:10.997724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:10.998003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.004951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.006396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:11.018546 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:11.019706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:11.020909 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 515/1035] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:11.022074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871b9f-1634-408c-8b35-5b6e04e984cb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.025332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.036538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.063785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.064667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.065121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.065695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.066380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:11.066690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.068258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.079018 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 521/1036] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:11.080331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.090824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.136245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552c3b-a49c-4cf6-9b1f-da1c8997364a None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.174795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.175415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.175698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.175998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.176790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:11.177096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.178527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.191817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971abde6-34a0-4a03-a8da-a72324d95f5a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.196187 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 516/1037] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:11.202397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.230827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.231450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.231818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.232021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.232766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] RBAC: Adding query filter params (interface=public, service_id=2164e78c19284a32aac746a1eefced75, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:11.233076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.234440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.239499 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 522/1038] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/endpoints?service_id=2164e78c19284a32aac746a1eefced75&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:11.244878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.273158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.313555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efdde7-144d-4e4a-b995-bee7c86e3faa None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.320644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.351621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.352263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.352544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.352816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.353529 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0beb7b-adbe-4c88-9345-00ddd2e02de7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.387225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.387916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.388285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.388630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.389360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.390766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.406576 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 523/1039] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:06:11.424742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.428234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.501384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.541722 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 517/1040] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:06:11.548011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.653735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b170e-a8c9-4a2f-964c-aaa4b9087962 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.686999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.687648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.687946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.688237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.690166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:11.700834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.702287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:11.718038 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:11.718963 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:11.719860 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:11.719860 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:11.719860 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:11.719860 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:11.719860 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 524/1041] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:11.724977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.827133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb24370-36f7-45a1-b70e-9edd372f30ed None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:11.862095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:11.862714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:11.863006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:11.863268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:11.863968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:11.864278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:11.865633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:11.878459 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 518/1042] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:11.884061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:11.987800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b3cd1-6a39-4b71-b024-12dc3245faa8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.021554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.022327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.022704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.023095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.030128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.031710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-866a2742-f49f-452a-9e68-6e24f2b22876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:12.043495 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:12.044618 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:12.045751 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:12.047239 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 525/1043] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:12.052819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.082821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.157666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b4281-3da5-4006-888f-5edaced889d2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.191720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.192365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.192649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.192922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.193922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.194045 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.195366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.195468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e77-b7d1-43c4-b563-03cd495c2f90 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.195658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e77-b7d1-43c4-b563-03cd495c2f90 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.195947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e77-b7d1-43c4-b563-03cd495c2f90 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.197463 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 526/1044] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:12.202999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.203296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.203579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.214615 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 519/1045] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:12.215241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.227213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:12.228573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:12.273465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.301756 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 527/1046] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:12.311574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.325491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.328370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39baaff-44c3-44f3-9a13-ebb2e365a101 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.375402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.376050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.376333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.376606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.377393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] RBAC: Adding query filter params (role.id=7bd9c281b7094184893aa3dde43ff4ae, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.377706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.379131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.395968 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 520/1047] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=7bd9c281b7094184893aa3dde43ff4ae => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:12.455823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce18f0b-f17c-4d78-86e4-92fd3f8a1197 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.494839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.496277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.496619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.496956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.508701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:12.513851 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:12.514855 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:12.515686 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 528/1048] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:12.521350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.629782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5384-403b-4829-a4f7-31710c14a2c9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.663583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.664224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.664559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.664831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.665567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:12.665869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.668154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.680812 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 521/1049] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:12.682010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.718990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.785416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0e78-31ef-448d-9a9f-ecc2a5f64cda None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.819145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.819783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.820094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.820369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] PATH_INFO: `/v3/users/5baad911bd824250b869fa94973ad737` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:12.834325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] RBAC: Authorizing `identity:get_user(user_id=5baad911bd824250b869fa94973ad737)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:12.836057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:12.843624 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 529/1050] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/users/5baad911bd824250b869fa94973ad737 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:12.843795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:12.859628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:12.944828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d962e2-38bf-4698-b570-9caaafb9bc35 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:12.978388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:12.979004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:12.979283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:12.980224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.047424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.048897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.063298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.159969 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 522/1051] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:13.161757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.258693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.266402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6511eb-9dbf-439f-8e88-ef244d5a9a61 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.301189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.301970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.302351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.302740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.304005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.305530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135979d-d678-4c6c-988d-4e4e234020bf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.312005 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 530/1052] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:13.314572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.415201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdfb3-2f6a-4acd-b537-c8a00bba15a6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.433270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.444923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dee36-bc75-4503-bdc4-e4cb32f95fbb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.445640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dee36-bc75-4503-bdc4-e4cb32f95fbb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.445640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dee36-bc75-4503-bdc4-e4cb32f95fbb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.446971 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 531/1053] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:13.452137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.452421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.452695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.461913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.462531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.462979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.463254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.464681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=a8db4e646f8847f18dfb32aeed64f37e, user.id=5baad911bd824250b869fa94973ad737) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:13.464985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.466410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.472009 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 523/1054] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/role_assignments?user.id=5baad911bd824250b869fa94973ad737&scope.project.id=a8db4e646f8847f18dfb32aeed64f37e&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:13.472285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:13.473478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:13.551299 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 532/1055] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:13.574081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.680218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa94c-12c2-4038-af81-4266b099d6c0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.715421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.716090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.716373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.716648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.717338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.718697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:13.727388 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:13.730302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 31 01:06:13.732332 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:13.734165 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 524/1056] 10.222.0.47 () {56 vars in 1105 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:13.737277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.831362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.841655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd50568-c04f-48d0-8201-2a3e275ab562 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:13.876440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:13.877061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:13.877341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:13.877612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:13.878282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:13.878583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:13.879957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:13.890122 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 533/1057] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:13.891687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:13.938359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:13.999549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d03374-052e-4753-8966-288060d3c7b9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:14.034538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:14.035162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.035447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.035722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.036633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] RBAC: Adding query filter params (type=image) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:14.036949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:14.038322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535d014-24c2-42f5-934b-444c5d19425a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:14.048132 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 525/1058] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:14.049360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:14.158879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acff34-c3f9-485f-9828-031b9beb8f7e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:14.194902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:14.195526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.195814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.196127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.196848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:14.198872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac9be0-0774-4cab-8c34-9257cb263f4a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:14.226166 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 534/1059] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:06:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:14.428028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0c02-0efe-41ea-bc42-4301eeaf05e2 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.428201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0c02-0efe-41ea-bc42-4301eeaf05e2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.428484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d0c02-0efe-41ea-bc42-4301eeaf05e2 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.430165 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 526/1060] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:14.436194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.436485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.436763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.458352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:14.459530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:14.468270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:14.538325 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 535/1061] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:14.560808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d0c02-0efe-41ea-bc42-4301eeaf05e2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:14.668772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d0c02-0efe-41ea-bc42-4301eeaf05e2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:14.671122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:14.704910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:14.705465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.705743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.706064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.717978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:14.722934 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:14.723897 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:14.725036 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:14.728234 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 527/1062] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:06:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:14.730879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:14.830735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423e2c-2bb5-47b9-b69e-7077513faa18 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:14.865872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:14.866489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:14.866769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:14.867044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:14.867814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:14.868148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:14.869510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:14.874928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:14.883454 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 536/1063] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:06:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:14.884623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:14.985775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad10778-57ae-436f-add3-e35f0f40a87d None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.020371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.021003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.021285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.021558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.031635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.033101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:15.047809 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:15.048720 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:15.049587 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:15.049587 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:15.049587 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:15.049587 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:15.052012 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 528/1064] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:15.054785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.163159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6008ebe-acd4-47e7-b984-1f5e4dbb5942 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.197666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.199343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.199343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.199599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.200216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:15.200521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.201874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.214897 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 537/1065] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:15.220331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.239919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:15.324017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03241e-f4ea-4a08-9379-7f239859a274 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.362043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.362712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.362991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.363263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.373036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.374625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-8997a67d-d219-4e1b-8873-f3ea8cc28262 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:15.387632 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:15.388620 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:15.389584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:15.393740 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 529/1066] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:15.394724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.464425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:15.494141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efca72-a351-485d-a763-01afe4ecb354 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.494412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efca72-a351-485d-a763-01afe4ecb354 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.494626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efca72-a351-485d-a763-01afe4ecb354 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.496146 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 530/1067] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:15.501444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.501730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.502011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.508927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f579b3f-2515-42a7-b894-978fd4eb2ba9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.521749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:15.522928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:15.546221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.547145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.547687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.547995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.548781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:15.549087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.550712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.569859 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 538/1068] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:15.575503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.595978 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 531/1069] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:15.616264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.624507 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:15.687754 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7256d-fe18-4028-97e0-479b70d66f13 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.708475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:15.727745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f546a5-c13e-4b50-8bf5-8b51e6694bf6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.730208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.730887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.731307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.731589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.742879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.744579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:15.761926 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:15.762827 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:15.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:15.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:15.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:15.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:15.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 539/1070] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:15.768604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.768805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.769423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.769673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.769952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.781628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:15.786514 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:15.787430 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:15.788341 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:15.793293 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 532/1071] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:15.794346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.865154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:15.876306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacbdda-e44f-4c90-9957-058d92127ddc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.903299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6144d3-db12-4aa7-90fc-862014dde3e2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:15.913105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.914104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.914454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.914742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.915429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:15.915735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.917301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.930109 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 540/1072] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:15.937220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.940683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:15.941320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:15.941594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:15.941872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:15.942624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:15.942931 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:15.944344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:15.953546 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 533/1073] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:15.959448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:15.976926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.053872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce2c8-c130-434e-996a-be69cf88a453 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.063732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0490f-c02a-4f17-9f2b-abc6e1e4b5b2 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.091463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.093788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.094470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.094751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.095057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.100219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.100864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.101149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.101426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] PATH_INFO: `/v3/users/5baad911bd824250b869fa94973ad737` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.102604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] RBAC: Authorizing `identity:get_user(user_id=5baad911bd824250b869fa94973ad737)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.102708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.104068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.104186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.106590 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 534/1074] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/users/5baad911bd824250b869fa94973ad737 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:16.112395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:16.122615 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:16.123549 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:16.124573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:16.128298 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 541/1075] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:16.130701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.222493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.226041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43622a-26bf-4e5d-a7c3-63b02e19e845 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.234705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecca40d-dd56-4b18-a9d6-037b13fddf6c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.262845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.263493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.263812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.264091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.265267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.266787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.268583 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 535/1076] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:16.272962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.273678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.273967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.274230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.274332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.275060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:16.275297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.277371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f97c3f-9358-4a8c-bbb0-9743fd77385f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.290225 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 542/1077] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:16.291597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f34-d8ba-4775-bf7a-00fce584753e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.292392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f34-d8ba-4775-bf7a-00fce584753e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.292686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c26f34-d8ba-4775-bf7a-00fce584753e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.293921 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 543/1078] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:16.296802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f34-d8ba-4775-bf7a-00fce584753e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.341274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.387124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6f595-a432-4006-b590-2d2f1dd76e65 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.400350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c26f34-d8ba-4775-bf7a-00fce584753e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.421071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.421742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.422024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.422304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e/users/5baad911bd824250b869fa94973ad737/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.424306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8db4e646f8847f18dfb32aeed64f37e, user_id=5baad911bd824250b869fa94973ad737, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.425756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fddbfd0-2f2b-4c38-9761-17df95276d24 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.437129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.437805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.438089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.438368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/7bd9c281b7094184893aa3dde43ff4ae` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.438820 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 536/1079] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:06:16 2022] PUT /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e/users/5baad911bd824250b869fa94973ad737/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:06:16.452685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.452685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.452685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.453019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=6f8bf5d3a0014e24af8195f4cdb1bf66, role_id=7bd9c281b7094184893aa3dde43ff4ae)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.453019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.460761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:16.462046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:16.475354 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 544/1080] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:06:16 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/6f8bf5d3a0014e24af8195f4cdb1bf66/roles/7bd9c281b7094184893aa3dde43ff4ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:06:16.555549 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 537/1081] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:16.580451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.594476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.694317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fabc-63f4-4d9f-ad21-7063a24720c1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:16.729041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:16.730216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:16.730513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:16.730776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:16.799211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:16.800689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:16.812088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:16.908160 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 545/1082] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:16.911351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:16.970699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:17.018761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a27e4-f3f0-4434-9f48-8f4f1eb3157d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:17.052739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:17.053382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:17.053663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:17.053936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:17.064792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:17.066244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-aba5c53b-9085-4087-88f8-528955ed2c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:17.081892 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:17.082812 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:17.089683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:17.089683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:17.089683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:17.089683 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:17.089683 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 538/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:17.091422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:17.192162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a05563-92a0-4425-86e8-6e40531bde9e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:17.204700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:17.230423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:17.231051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:17.231334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:17.231609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:17.232331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:17.232641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:17.234034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53768c3-f334-447b-b697-5ff2eccd0704 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:17.246395 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 546/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:18.482479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279ed2-d2d2-4691-9887-ae9e5a334f15 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.482985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279ed2-d2d2-4691-9887-ae9e5a334f15 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.483093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17279ed2-d2d2-4691-9887-ae9e5a334f15 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.484419 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 539/1085] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:18.489813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.490223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.490376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.508310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:18.509500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:18.524906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aeb6-88d1-48ca-b3c9-4ef9dbe1f015 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.525195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aeb6-88d1-48ca-b3c9-4ef9dbe1f015 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.525471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538aeb6-88d1-48ca-b3c9-4ef9dbe1f015 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.527530 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 540/1086] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:06:18.532286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.532570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.532846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.554263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:18.555806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:18.580000 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 547/1087] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:18.603389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.625055 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 541/1088] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:06:18.648670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.683660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:18.702258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:18.705217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34320600-9dae-488e-8996-6f506b710ca6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:18.740787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:18.741421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.741700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.742197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.750959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01fd78-542b-4ea1-835c-7e58663d4db8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:18.752903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:18.760156 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:18.761984 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:18.763212 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 548/1089] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:18.770012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.792167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:18.793048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.793308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.793585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.804152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:18.809612 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:18.810604 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:18.811441 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 542/1090] 10.222.0.47 () {56 vars in 1120 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:18.816722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.873081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd8af-afad-4a9d-b669-d778bd335eaf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:18.906973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:18.907590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.907877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.908189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.908912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:18.909222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:18.910589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:18.911478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:18.918066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e510a-ffc2-4170-a713-b828c1d49bf3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:18.919636 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 549/1091] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:18.925195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:18.950283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:18.953691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:18.954256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:18.954538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:18.954813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:18.955529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:18.955833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:18.957230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:18.965712 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 543/1092] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:18.971231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.027009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744089-27e3-4f39-8568-9aee51f90964 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.062935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.063610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.063908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.064217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] PATH_INFO: `/v3/users/5baad911bd824250b869fa94973ad737` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.065411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] RBAC: Authorizing `identity:get_user(user_id=5baad911bd824250b869fa94973ad737)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.066843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.068640 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 550/1093] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/users/5baad911bd824250b869fa94973ad737 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:19.070296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314de374-818a-4e9f-b918-49ae459a1fa9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.074229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.106249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12043493-7089-411c-868a-5025178cb2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.107007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043493-7089-411c-868a-5025178cb2dd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.107293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043493-7089-411c-868a-5025178cb2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.107564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043493-7089-411c-868a-5025178cb2dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.118436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12043493-7089-411c-868a-5025178cb2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.119890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12043493-7089-411c-868a-5025178cb2dd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-12043493-7089-411c-868a-5025178cb2dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:19.134696 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:19.135723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:19.137150 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:19.137150 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:19.137150 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:19.137150 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:19.137150 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 544/1094] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:19.141901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12043493-7089-411c-868a-5025178cb2dd None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.154473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.172159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.181695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205881e-e67b-4a5c-a946-6ec03c2e54cb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.215626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.216201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.216486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.216761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.244007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12043493-7089-411c-868a-5025178cb2dd None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.278757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.279372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.279658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.279960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.280659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:19.280969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.282330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.285683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.287134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.294068 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 545/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:19.299728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.368129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.378008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.389470 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 551/1096] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:06:19.395207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.401314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96b41-1fb2-4dbf-9c3d-377d6a7c2495 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.435641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.436321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.436609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.436889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.444130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.445582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:06:19.458508 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:19.459561 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 31 01:06:19.460824 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:19.464089 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 546/1097] 10.222.0.47 () {56 vars in 1093 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:19.465905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.496408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11fd0-9fd8-422a-9c07-67ee3a84e8ae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.530486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.531117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.531398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.531674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.532860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.534275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.535943 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 552/1098] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:19.542163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.566974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29a8e5-b1cf-437b-870f-fd216bb4e18e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.597841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.600974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.604596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.605222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.605523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.605866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.606686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:19.607010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.608494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.627070 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 547/1099] 10.222.0.47 () {56 vars in 1133 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:19.632920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:19.643491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3383-38b5-465b-80ec-fc5c1c2996c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.677006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.677623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.677970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.678255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.679047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=a8db4e646f8847f18dfb32aeed64f37e, user.id=5baad911bd824250b869fa94973ad737) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:19.679362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.680821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.687840 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 553/1100] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/role_assignments?user.id=5baad911bd824250b869fa94973ad737&scope.project.id=a8db4e646f8847f18dfb32aeed64f37e&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:19.736962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316f15b-593e-4140-a21e-4b5fb9f9be79 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:19.775023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:19.775649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:19.775949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:19.776798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:19.833754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:19.849946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:19.851414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:19.951227 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 548/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:06:19.957019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:20.059594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fcbf-7577-4581-89fb-9e3eeb152da4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:20.082084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:20.094693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:20.095355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:20.095620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:20.095897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:20.107167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:20.108688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:20.122942 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:20.124111 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:20.125025 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:06:20.125025 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:20.125025 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:06:20.125025 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:20.125025 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 554/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:20.129786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:20.216600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:20.228966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4561a-f4c3-4e25-b84c-cdd1ae8fc139 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:20.263364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:20.263999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:20.264283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:20.264556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:20.265239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:20.265542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:20.266898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:20.277935 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 549/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:20.283657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:20.382161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4cee6-b05e-4c59-8188-f85120bcdc9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:20.415282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:20.415923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:20.416237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:20.416515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:20.423382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:20.424860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:06:20.437795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:20.438870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:20.440070 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 555/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:06:20.444920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:20.544154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5fd68-cb96-457b-92e0-d4a996f9c7e5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:20.577841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:20.578477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:20.578727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:20.579037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:20.579814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:20.580156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:20.581660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0b470-1972-4bbc-8a1c-fb2a35f55bd9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:20.597468 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 550/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:20.604164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:20.643099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:20.712368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060677f-7bff-4693-9815-b0a6ed40555c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:20.749809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:20.750424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:20.750708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:20.750985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:20.751765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] RBAC: Adding query filter params (role.id=7bd9c281b7094184893aa3dde43ff4ae, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=6f8bf5d3a0014e24af8195f4cdb1bf66) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:20.752120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:20.753538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188cedd-c569-49dd-b98c-082bb86838b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:20.759289 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 556/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:20 2022] GET /identity/v3/role_assignments?user.id=6f8bf5d3a0014e24af8195f4cdb1bf66&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=7bd9c281b7094184893aa3dde43ff4ae => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:21.804670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa130-a9a8-48ff-a40e-a3beb3dbf5df None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.805159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa130-a9a8-48ff-a40e-a3beb3dbf5df None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.805159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abaa130-a9a8-48ff-a40e-a3beb3dbf5df None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.806464 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 551/1107] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:21.812100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:21.812484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:21.812665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:21.831211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:21.832433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:21.898120 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 557/1108] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:21.922544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa130-a9a8-48ff-a40e-a3beb3dbf5df None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:21.933970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:22.024324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abaa130-a9a8-48ff-a40e-a3beb3dbf5df None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:22.058739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:22.059303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:22.059585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:22.059858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:22.061028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:22.062446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f70d4a-f249-473d-9df3-ebed6dedd0e3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:22.064040 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 552/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:22.069740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:22.097376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:22.168678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410c790-30f2-4a6b-9a91-53bb16c77276 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:22.202067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:22.202670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:22.202956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:22.203235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:22.203952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:22.205380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff06c3-2db2-451c-86fd-39ea072f1dfb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:22.226866 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 558/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:06:22 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:06:24.247874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede146d-8e3b-494e-9cd7-e1716bcb4316 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.248444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede146d-8e3b-494e-9cd7-e1716bcb4316 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.248586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede146d-8e3b-494e-9cd7-e1716bcb4316 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.249942 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 553/1111] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:24.255030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.255417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.255577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.273258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:24.274435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:24.339314 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 559/1112] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:24.362962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede146d-8e3b-494e-9cd7-e1716bcb4316 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.440559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:24.464952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede146d-8e3b-494e-9cd7-e1716bcb4316 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.498705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.499271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.499551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.499823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] PATH_INFO: `/v3/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.501280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] RBAC: Authorizing `identity:get_role(role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.502638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.503998 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 554/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:24.509908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.524746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:24.608691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0f55-9f8d-4ba1-a63f-0e476a292df2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.642712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.643344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.643630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.643907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] PATH_INFO: `/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.656797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=0ad7eb6a1c74472facf135f6fc6d61c2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.658243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.659879 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 560/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:24.665645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:24.762569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d3b4-0e54-4b36-b744-35fde4bc01b6 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:24.794524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:24.795125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:24.795405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:24.795676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:24.809970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:24.862748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:24.864210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:24.958774 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 555/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:24.965524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:25.033998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:25.062628 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99818-05b1-4620-94c3-28da48f3dfb4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:25.098121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:25.098753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:25.099032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:25.099301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:25.100483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:25.101892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006e313-36ab-4cf7-8438-099db9a42f3f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:25.103533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 561/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:24 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:25.109768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:25.154574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:25.207556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250dae8-a8e7-4841-b1e0-ad0de21be640 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:25.241781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:25.242391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:25.242678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:25.242954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:25.243741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=a8db4e646f8847f18dfb32aeed64f37e, user.id=0ad7eb6a1c74472facf135f6fc6d61c2) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:25.244088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:25.245553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9ac43-d86c-437a-8594-2370ab69e384 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:25.250907 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 556/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:25 2022] GET /identity/v3/role_assignments?user.id=0ad7eb6a1c74472facf135f6fc6d61c2&scope.project.id=a8db4e646f8847f18dfb32aeed64f37e&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:27.227102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e9ab-5cca-4b69-8440-51ee3fa85b58 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.227631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e9ab-5cca-4b69-8440-51ee3fa85b58 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.227720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e9ab-5cca-4b69-8440-51ee3fa85b58 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.229058 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 562/1118] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:27.234861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.235260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.235423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.253940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:27.255138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:27.321730 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 557/1119] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:27.345858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e9ab-5cca-4b69-8440-51ee3fa85b58 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:27.445826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e9ab-5cca-4b69-8440-51ee3fa85b58 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:27.480778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:27.481334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.481615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.481891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] PATH_INFO: `/v3/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.483337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] RBAC: Authorizing `identity:get_role(role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:27.484737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:27.486082 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 563/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:27 2022] GET /identity/v3/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:27.491904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:27.532153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:27.590960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f88bf-08e1-4bf3-8a82-7da6cf24d6e7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:27.624955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:27.625582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.625865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.626139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] PATH_INFO: `/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.627289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] RBAC: Authorizing `identity:get_user(user_id=0ad7eb6a1c74472facf135f6fc6d61c2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:27.628751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:27.630345 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 558/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:27 2022] GET /identity/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:27.636251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:27.646903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:27.734441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e2637-30a5-4d17-8880-30f6f096437f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:27.767235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:27.767878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.768195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.768477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.769639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:27.771061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed93c98-070a-49c5-8dad-fea2824d7504 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:27.772841 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 564/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:27 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:27.779238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:27.878198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba057ae4-16d7-4e03-aa06-82ca69c1931c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:27.886079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:27.912435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:27.913095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:27.913380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:27.913655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e/users/0ad7eb6a1c74472facf135f6fc6d61c2/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:27.915826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8db4e646f8847f18dfb32aeed64f37e, user_id=0ad7eb6a1c74472facf135f6fc6d61c2, role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:27.917396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20215f-4ec6-48a0-a152-fd90b07694e5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:27.929456 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 559/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:06:27 2022] PUT /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e/users/0ad7eb6a1c74472facf135f6fc6d61c2/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:06:29.904187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c65c-6e5e-4363-9509-3c6204dca933 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:29.904778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c65c-6e5e-4363-9509-3c6204dca933 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:29.904778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6c65c-6e5e-4363-9509-3c6204dca933 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:29.906074 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 565/1124] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:29.911443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:29.911895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:29.912050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:29.930030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:29.931217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:29.998021 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 560/1125] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:30.021644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c65c-6e5e-4363-9509-3c6204dca933 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:30.097707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.121574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6c65c-6e5e-4363-9509-3c6204dca933 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:30.154494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:30.155062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.155341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.155611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] PATH_INFO: `/v3/roles/e5b496fb5d1349f088afecafae3c1cd0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.157063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] RBAC: Authorizing `identity:get_role(role_id=e5b496fb5d1349f088afecafae3c1cd0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:30.158413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:30.159736 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 566/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:30 2022] GET /identity/v3/roles/e5b496fb5d1349f088afecafae3c1cd0 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:30.165596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:30.258130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.265539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e5b4a-18c9-4173-a9c9-2b184bf234ce None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:30.299468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:30.300135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.300423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.300700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] PATH_INFO: `/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.301857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] RBAC: Authorizing `identity:get_user(user_id=0ad7eb6a1c74472facf135f6fc6d61c2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:30.303285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:30.304917 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 561/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:30 2022] GET /identity/v3/users/0ad7eb6a1c74472facf135f6fc6d61c2 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:30.311275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:30.409861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc522e-e62b-4bf5-a798-7bfb2b3cb1e7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:30.444507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:30.445270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.445396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.445670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.460279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.513206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:30.514639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:30.611348 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 567/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:30.617593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:30.715810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9e246-d113-4c87-984f-c9b0a11055ee None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:30.749228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:30.749864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.750147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.750419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] PATH_INFO: `/v3/projects/a8db4e646f8847f18dfb32aeed64f37e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.751568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] RBAC: Authorizing `identity:get_project(project_id=a8db4e646f8847f18dfb32aeed64f37e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:30.753024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026d104-eeb9-4e24-8ef8-d63af686d9fd None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:30.754666 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 562/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:30 2022] GET /identity/v3/projects/a8db4e646f8847f18dfb32aeed64f37e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:30.761560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:30.804983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:30.859578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790380-3a72-4e7d-9261-b3423f7488d5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:30.893464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:30.894072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:30.894355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:30.894630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:30.895412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] RBAC: Adding query filter params (role.id=e5b496fb5d1349f088afecafae3c1cd0, scope.project.id=a8db4e646f8847f18dfb32aeed64f37e, user.id=0ad7eb6a1c74472facf135f6fc6d61c2) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:30.895721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:30.897175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d00556-3221-4ed4-99cf-7ee52d1a630a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:30.903098 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 568/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:30 2022] GET /identity/v3/role_assignments?user.id=0ad7eb6a1c74472facf135f6fc6d61c2&scope.project.id=a8db4e646f8847f18dfb32aeed64f37e&role.id=e5b496fb5d1349f088afecafae3c1cd0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:32.961772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253edcf-19d0-432f-b993-25483789da58 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:32.962305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253edcf-19d0-432f-b993-25483789da58 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:32.962305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253edcf-19d0-432f-b993-25483789da58 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:32.964403 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 563/1131] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:32.969679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:32.970096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:32.970232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:32.988512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:32.989692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:33.056119 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 569/1132] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:33.080032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253edcf-19d0-432f-b993-25483789da58 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:33.114283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.184402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253edcf-19d0-432f-b993-25483789da58 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:33.217976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:33.218553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:33.218840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:33.219119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:33.220312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:33.221746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6564d-1f0e-431b-8bdc-134b56f62c00 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:33.223343 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 564/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:33.229981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:33.269000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:33.326950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0bb45-db90-4391-a386-39563e06991e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:33.360505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:33.361116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:33.361401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:33.361681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:33.362362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:33.363788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf4c8d-4786-4501-abcf-86c6afb47632 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:33.390239 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 570/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:33 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:35.427993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca23b0-56ae-49bb-a7fe-4d6998529e33 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.428547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca23b0-56ae-49bb-a7fe-4d6998529e33 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.428547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca23b0-56ae-49bb-a7fe-4d6998529e33 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.429885 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 565/1135] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:35.435646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.436081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.436233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.454700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:35.455884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:35.521142 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 571/1136] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:35.545224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca23b0-56ae-49bb-a7fe-4d6998529e33 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:35.641556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:35.645581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca23b0-56ae-49bb-a7fe-4d6998529e33 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:35.678458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:35.679030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.679312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.679585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.680759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:35.682716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fbd00-7274-48b9-b30b-50143ce684ff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:35.684320 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 566/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:35.690077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:35.710616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:35.789236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bb6ed-c85b-4814-944d-dd089517bd1b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:35.823653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:35.824286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:35.824570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:35.824846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:35.825533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:35.826961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd4dec-e176-4b27-a691-61f51a32800b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:35.847822 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 572/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:06:35 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:37.884676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366045c6-ae28-4565-99c1-ec72d24fd625 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:37.885704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366045c6-ae28-4565-99c1-ec72d24fd625 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:37.885895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366045c6-ae28-4565-99c1-ec72d24fd625 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:37.887438 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 567/1139] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:37.892758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:37.893182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:37.893311 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:37.911609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:37.912812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:37.977566 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 573/1140] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:38.001170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366045c6-ae28-4565-99c1-ec72d24fd625 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:38.102859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366045c6-ae28-4565-99c1-ec72d24fd625 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.137100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.137667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.137952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.138244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.148116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:38.153302 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:38.154450 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:38.155559 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 568/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:38.160498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:38.168527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.259198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3ec3-41e7-4409-bec2-013333d96e4c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.292777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.293383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.293661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.293934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.294650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:38.294956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:38.296464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:38.304212 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 574/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:38.310699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:38.340230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.410620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397289-4772-4cd7-b020-0f2b23f9ede9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.444068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.445105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.445105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.445301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] PATH_INFO: `/v3/users/1464fdb902f9479993a085f1e7984fee` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.458791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] RBAC: Authorizing `identity:get_user(user_id=1464fdb902f9479993a085f1e7984fee)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:38.460259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:38.462137 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 569/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/users/1464fdb902f9479993a085f1e7984fee => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:38.468703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:38.534290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.567045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636460-7a6d-4856-94f9-cd22e434b7c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.600257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.600859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.601139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.601414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.665397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:38.667388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:38.729234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.762503 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 575/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:38.768443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:38.850964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:38.865407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032254d-b888-43bc-92fa-723b2ee607f5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:38.898583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:38.899213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:38.899488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:38.899759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] PATH_INFO: `/v3/projects/688d247dc92146b896e6ef8e5cde9cfa` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:38.901080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] RBAC: Authorizing `identity:get_project(project_id=688d247dc92146b896e6ef8e5cde9cfa)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:38.902497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b2b3b-8f10-4f3a-9841-d20d2e503020 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:38.904158 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 570/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/projects/688d247dc92146b896e6ef8e5cde9cfa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:38.910375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:39.006244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0e4bb-ba00-4e1a-89d5-bb62a050b9a5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:39.038939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:39.039540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:39.039822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:39.040138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:39.040919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=688d247dc92146b896e6ef8e5cde9cfa, user.id=1464fdb902f9479993a085f1e7984fee) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:39.041227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:39.042769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db021700-1e75-44a1-965c-6e2221bf2edb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:39.048174 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 576/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:38 2022] GET /identity/v3/role_assignments?user.id=1464fdb902f9479993a085f1e7984fee&scope.project.id=688d247dc92146b896e6ef8e5cde9cfa&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:41.014952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c89-d515-467d-a966-0f7c142466c6 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.015505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c89-d515-467d-a966-0f7c142466c6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.015505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2c89-d515-467d-a966-0f7c142466c6 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.016902 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 571/1147] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:41.021928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.022356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.022487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.040597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:41.041881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:41.066972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.107755 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 577/1148] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:41.130368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2c89-d515-467d-a966-0f7c142466c6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.230771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2c89-d515-467d-a966-0f7c142466c6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.264724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.265443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.265676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.265953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.275951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:41.280836 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:41.281958 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:41.282974 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 572/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:41.288092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.383281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2137a-6119-4fba-b5d6-457f4ae315b9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.415680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.416381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.416706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.417001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.417675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:41.417977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:41.419336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:41.427050 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 578/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:41.433596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.451100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.534041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fa3be-badc-477c-8095-e8a72eebdf41 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.566141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.566771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.567054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.567327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] PATH_INFO: `/v3/users/1464fdb902f9479993a085f1e7984fee` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.568508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] RBAC: Authorizing `identity:get_user(user_id=1464fdb902f9479993a085f1e7984fee)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:41.569937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:41.571536 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 573/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:41 2022] GET /identity/v3/users/1464fdb902f9479993a085f1e7984fee => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:41.578035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.604224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.676049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69cc1-228c-4b57-afeb-46ec3318a1ed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.708811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.709442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.709731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.710008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] PATH_INFO: `/v3/projects/688d247dc92146b896e6ef8e5cde9cfa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.711424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] RBAC: Authorizing `identity:get_project(project_id=688d247dc92146b896e6ef8e5cde9cfa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:41.712871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2e58-f01e-495c-811b-13d577cf6191 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:41.715077 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 579/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:41 2022] GET /identity/v3/projects/688d247dc92146b896e6ef8e5cde9cfa => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:41.721069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:41.799637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:41.817566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee358cd8-90ae-4bb1-8c2d-bb7c39010009 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:41.849780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:41.850428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:41.850712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:41.850985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] PATH_INFO: `/v3/projects/688d247dc92146b896e6ef8e5cde9cfa/users/1464fdb902f9479993a085f1e7984fee/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:41.852923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] RBAC: Authorizing `identity:create_grant(project_id=688d247dc92146b896e6ef8e5cde9cfa, user_id=1464fdb902f9479993a085f1e7984fee, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:41.854395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d156d1-6f6c-4ccb-a6ce-c8cb1d987af4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:41.867304 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 574/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:06:41 2022] PUT /identity/v3/projects/688d247dc92146b896e6ef8e5cde9cfa/users/1464fdb902f9479993a085f1e7984fee/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:06:43.846721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6f1a-13af-49c7-8b2d-315a110c0dac None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:43.847252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6f1a-13af-49c7-8b2d-315a110c0dac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:43.847359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a6f1a-13af-49c7-8b2d-315a110c0dac None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:43.848678 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 580/1154] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:43.853757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:43.854190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:43.854316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:43.873269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:43.874447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:43.939386 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 575/1155] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:43.962554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6f1a-13af-49c7-8b2d-315a110c0dac None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.053516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.064309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a6f1a-13af-49c7-8b2d-315a110c0dac None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.098568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.099136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.099419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.099696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.110188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:44.115061 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:44.116181 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:44.117055 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 581/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:44.122746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.191415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.221718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83baf5b-9fa4-4a08-8393-fb09f96decf5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.254843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.255457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.255742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.256050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.256760 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:44.257066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.258431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:44.266375 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 576/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:44.272144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.372125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2397538-10ec-4fc5-8ac6-67068a9b3ca2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.405123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.405745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.406028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.406303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] PATH_INFO: `/v3/users/1464fdb902f9479993a085f1e7984fee` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.407459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] RBAC: Authorizing `identity:get_user(user_id=1464fdb902f9479993a085f1e7984fee)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.408919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:44.410508 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 582/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/users/1464fdb902f9479993a085f1e7984fee => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:44.416371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.515301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00576de3-960c-4e8d-949a-40d34552d79e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.548565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.549176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.549461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.549738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.552367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.616672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.618110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:44.713934 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 577/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:44.719828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.741487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.818085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce337d-d75d-416e-bdd6-eb5342c9de42 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.851562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.852235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.852526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.852801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] PATH_INFO: `/v3/projects/688d247dc92146b896e6ef8e5cde9cfa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.854509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] RBAC: Authorizing `identity:get_project(project_id=688d247dc92146b896e6ef8e5cde9cfa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.855954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fc380-7482-47c6-87b7-905036106ddd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:44.857604 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 583/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/projects/688d247dc92146b896e6ef8e5cde9cfa => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:44.863791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:44.895669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:44.959775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b25c8-1cb5-4229-bff8-7ad19ec5a91f None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:44.993042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:44.993581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:44.993857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:44.994124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:44.994940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=688d247dc92146b896e6ef8e5cde9cfa, user.id=1464fdb902f9479993a085f1e7984fee) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:44.995239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:44.996678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685913e7-961d-4ff8-95b9-ece286d8b02a None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:45.002236 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 578/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:44 2022] GET /identity/v3/role_assignments?user.id=1464fdb902f9479993a085f1e7984fee&scope.project.id=688d247dc92146b896e6ef8e5cde9cfa&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:47.007016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35be36-2e85-42ea-959e-9c49bb975662 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:47.007587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35be36-2e85-42ea-959e-9c49bb975662 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:47.007587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35be36-2e85-42ea-959e-9c49bb975662 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:47.008950 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 584/1162] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:47.014151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:47.014546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:47.014697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:47.032492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:47.033659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:47.098064 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 579/1163] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:47.120106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35be36-2e85-42ea-959e-9c49bb975662 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:47.206163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:47.220622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35be36-2e85-42ea-959e-9c49bb975662 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:47.258063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:47.258601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:47.258880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:47.259153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:47.324559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:47.325983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:47.407461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:47.419907 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 585/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:47.425891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:47.453559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:47.522724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff6756-9778-4065-b4c3-175c2c782ef7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:47.555376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:47.556030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:47.556312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:47.556583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:47.563793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:47.565249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-407f48ed-e8c8-4299-bcd3-b8b801d9edb0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:47.576700 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:47.577804 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:06:47.578653 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 580/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:06:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:47.583821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:47.684376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc87e5-d158-4321-80ee-680e29e39766 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:47.720257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:47.720865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:47.721149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:47.721426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:47.722114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:47.722416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:47.723764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce138f-80d8-496e-974e-50d571a3115b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:47.730988 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 586/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Sun Jul 31 01:06:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:49.727792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d049b1-799b-4382-b5b7-c75506989d75 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:49.728341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d049b1-799b-4382-b5b7-c75506989d75 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:49.728341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d049b1-799b-4382-b5b7-c75506989d75 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:49.730267 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 581/1167] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:49.735390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408652c-c77c-4305-892f-5a6921f05944 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:49.735811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408652c-c77c-4305-892f-5a6921f05944 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:49.735966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408652c-c77c-4305-892f-5a6921f05944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:49.754407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9408652c-c77c-4305-892f-5a6921f05944 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:49.755601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9408652c-c77c-4305-892f-5a6921f05944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:49.800990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:49.821006 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 587/1168] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:49.844702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d049b1-799b-4382-b5b7-c75506989d75 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:49.932110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:49.944846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d049b1-799b-4382-b5b7-c75506989d75 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:49.978322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:49.978880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:49.979161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:49.979435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:49.980153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:49.981520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936e392-8391-40ab-a42b-395a96412c73 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:49.996566 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 582/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Sun Jul 31 01:06:49 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:52.049363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd664dfd-4ed7-4b61-be14-a67f533d1be1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:52.049915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd664dfd-4ed7-4b61-be14-a67f533d1be1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:52.050032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd664dfd-4ed7-4b61-be14-a67f533d1be1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:52.051333 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 588/1170] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:52.056431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:52.056913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:52.057276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:52.075594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:52.076808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:52.143504 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 583/1171] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:52.167617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd664dfd-4ed7-4b61-be14-a67f533d1be1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:52.268038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd664dfd-4ed7-4b61-be14-a67f533d1be1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:52.301233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:52.301804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:52.302091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:52.302369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] PATH_INFO: `/v3/domains/0697c63b3aba4faa859e054f0c78f49a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:52.313264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0697c63b3aba4faa859e054f0c78f49a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:52.314700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85be1e-a709-48ec-9878-c24326adaf59 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:52.316324 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 589/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Sun Jul 31 01:06:52 2022] GET /identity/v3/domains/0697c63b3aba4faa859e054f0c78f49a => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:52.322145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:52.397343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:52.419749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653498b-8713-4606-a1a3-3f272b154c84 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:52.452226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:52.452839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:52.453145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:52.453426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:52.454096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:52.455515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a9c17-5f2f-4a9c-8924-295bc6a485ee None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:52.483786 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 584/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:06:52 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:54.508541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca1e72-da2d-4822-b943-445385da230b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.509050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca1e72-da2d-4822-b943-445385da230b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.509141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca1e72-da2d-4822-b943-445385da230b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.510731 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 590/1174] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:54.515953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.516344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.516524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.534517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:54.535708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:54.604744 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 585/1175] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:54.629640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca1e72-da2d-4822-b943-445385da230b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:54.674242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:54.732193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca1e72-da2d-4822-b943-445385da230b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:54.765228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:54.765859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.766144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.766422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] PATH_INFO: `/v3/domains/0697c63b3aba4faa859e054f0c78f49a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.767580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] RBAC: Authorizing `identity:get_domain(domain_id=0697c63b3aba4faa859e054f0c78f49a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:54.769054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f6d52-c69f-43e3-86a7-ffcb3281ecda None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:54.770640 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 591/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Sun Jul 31 01:06:54 2022] GET /identity/v3/domains/0697c63b3aba4faa859e054f0c78f49a => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:54.776396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:54.833053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:54.873363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f36b4-72af-4e1b-9e65-4a0b37006d1b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:54.907060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:54.907671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:54.907978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:54.908262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:54.908939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:54.910375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5e0ee-d649-4327-8eb9-c5862c621cc9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:54.930763 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 586/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:06:54 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:06:56.949010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e872-e4da-4198-b0c6-5340e9f0fd4b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:56.949562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e872-e4da-4198-b0c6-5340e9f0fd4b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:56.949562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35e872-e4da-4198-b0c6-5340e9f0fd4b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:56.950919 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 592/1178] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:06:56.956494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:56.956864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:56.957047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:56.975117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:06:56.976332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:06:57.040633 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 587/1179] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:06:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:06:57.063357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35e872-e4da-4198-b0c6-5340e9f0fd4b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.162100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35e872-e4da-4198-b0c6-5340e9f0fd4b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.172796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.195576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.196228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.196513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.196782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.207581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:06:57.212698 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:06:57.213784 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:06:57.215381 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 593/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:06:57.220635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.265803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.317571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf681fb-a170-43f1-94f3-c58ef1646408 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.351053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.351657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.351963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.352246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.352955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:57.353261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:57.354957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:57.362731 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 588/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:06:57.368484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.466058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1bf2c4-462b-4858-abb8-1344297e6fcd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.498164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.498782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.499062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.499374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] PATH_INFO: `/v3/users/d1850d77c1c940a284a39266ffbbac33` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.512547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] RBAC: Authorizing `identity:get_user(user_id=d1850d77c1c940a284a39266ffbbac33)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:57.513968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:57.515569 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 594/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/users/d1850d77c1c940a284a39266ffbbac33 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:57.521338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.620436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd69b21-0059-42c1-a5a1-8959c8ec7411 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.628839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.653652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.654288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.654569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.654844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.719664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:57.721066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:57.814423 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 589/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:06:57.820299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.849119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:57.918508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13b7f-6c6e-4f41-a1a7-e8e6432c1b5a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:57.952025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:57.952657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:57.952941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:57.953218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] PATH_INFO: `/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:57.954372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] RBAC: Authorizing `identity:get_project(project_id=57122703b71c4fcdaeab2e9d17b1a3a7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:57.955789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2b9a-f219-47bc-acd4-35f2785cdc2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:57.957456 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 595/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:06:57.963968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:06:57.973909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:06:58.060365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207efbc-9caf-4af5-a3eb-6b8ce99d1cc3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:06:58.092948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:06:58.093550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:06:58.093835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:06:58.094112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:06:58.094889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=57122703b71c4fcdaeab2e9d17b1a3a7, user.id=d1850d77c1c940a284a39266ffbbac33) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:06:58.095197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:06:58.096649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1359d9-dac0-4176-b78d-45ee7bce86b4 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:06:58.101935 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 590/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:06:57 2022] GET /identity/v3/role_assignments?user.id=d1850d77c1c940a284a39266ffbbac33&scope.project.id=57122703b71c4fcdaeab2e9d17b1a3a7&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:00.062417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb2f1-c1c4-4de6-af0e-384bbd380055 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.063045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb2f1-c1c4-4de6-af0e-384bbd380055 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.063045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb2f1-c1c4-4de6-af0e-384bbd380055 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.064370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 596/1186] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:00.069409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.069819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.069970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.088759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:00.089963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:00.154975 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 591/1187] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:07:00.177291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb2f1-c1c4-4de6-af0e-384bbd380055 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.270932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:00.278657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb2f1-c1c4-4de6-af0e-384bbd380055 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.311988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.312669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.312907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.313184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.323783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:07:00.328629 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:07:00.329795 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:07:00.330891 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 597/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:07:00.335708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.338252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:00.432935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd341-1c49-44de-ae94-790947d8f20b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.466687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.467300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.467585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.467861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.468608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:07:00.468921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:00.470320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:00.478182 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 592/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:00.484260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.582599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1b2d-7388-4d66-842e-cdfeef738438 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.616239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.616872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.617158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.617433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] PATH_INFO: `/v3/users/d1850d77c1c940a284a39266ffbbac33` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.618877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] RBAC: Authorizing `identity:get_user(user_id=d1850d77c1c940a284a39266ffbbac33)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:00.621172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:00.622780 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 598/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:07:00 2022] GET /identity/v3/users/d1850d77c1c940a284a39266ffbbac33 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:00.628590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.689532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:00.726119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefb7fe-9bc9-4416-9a8a-d4323fc69269 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.758852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.759475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.759810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.760115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] PATH_INFO: `/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.761260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] RBAC: Authorizing `identity:get_project(project_id=57122703b71c4fcdaeab2e9d17b1a3a7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:00.762673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04daef2-36f3-4adb-9edf-3ab5782bab71 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:00.764339 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 593/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:07:00 2022] GET /identity/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:00.770430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:00.796011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:00.867743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b0e6f-50e2-46ee-bf7d-cb0bf24a2b76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:00.899914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:00.900620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:00.900940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:00.901162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] PATH_INFO: `/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7/users/d1850d77c1c940a284a39266ffbbac33/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:00.903063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=57122703b71c4fcdaeab2e9d17b1a3a7, user_id=d1850d77c1c940a284a39266ffbbac33, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:00.904510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5659a-6bc1-44b2-8d5b-dc5a45d897a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:00.917001 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 599/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:07:00 2022] PUT /identity/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7/users/d1850d77c1c940a284a39266ffbbac33/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:07:02.878269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d600c6-427a-4da5-9aef-c4c76aaaa9aa None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:02.878822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d600c6-427a-4da5-9aef-c4c76aaaa9aa None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:02.878822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d600c6-427a-4da5-9aef-c4c76aaaa9aa None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:02.880192 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 594/1193] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:02.885343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:02.885784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:02.885895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:02.903581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:02.904798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:02.970402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 600/1194] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:07:02.992832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d600c6-427a-4da5-9aef-c4c76aaaa9aa None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.094044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d600c6-427a-4da5-9aef-c4c76aaaa9aa None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:03.122080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.127256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:03.127877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:03.128348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:03.128577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:03.139286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:07:03.144204 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:07:03.145267 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:07:03.146125 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 595/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:07:03.152168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.167502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.250133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14300f2d-1067-4c14-98b5-defb6b0a2162 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:03.283308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:03.283913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:03.284229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:03.284503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:03.285208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:07:03.285512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:03.286862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:03.295625 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 601/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:03.301389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.398952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f959d-78ea-42f0-86f4-2a7387bcadc5 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:03.432960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:03.433590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:03.433869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:03.434141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] PATH_INFO: `/v3/users/d1850d77c1c940a284a39266ffbbac33` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:03.435419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] RBAC: Authorizing `identity:get_user(user_id=d1850d77c1c940a284a39266ffbbac33)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:03.436879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:03.438617 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 596/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Sun Jul 31 01:07:03 2022] GET /identity/v3/users/d1850d77c1c940a284a39266ffbbac33 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:03.444333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.520516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.542793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e5d30-1799-471b-8bf4-aae2179e53e0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:03.575725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:03.576351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:03.576636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:03.576912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:03.641729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:03.643174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:03.715569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.739661 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 602/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:07:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:07:03.746072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.803281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:03.843945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b268b67-c98b-4965-8278-e9dfcab7c113 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:03.877449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:03.878072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:03.878358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:03.878923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] PATH_INFO: `/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:03.879786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] RBAC: Authorizing `identity:get_project(project_id=57122703b71c4fcdaeab2e9d17b1a3a7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:03.881242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b36a48-9d59-4563-88f9-4fff4d60c05e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:03.882888 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 597/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Sun Jul 31 01:07:03 2022] GET /identity/v3/projects/57122703b71c4fcdaeab2e9d17b1a3a7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:03.888953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:03.985335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44764638-a70d-4a98-819b-4d026dedbcbf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:04.018260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:04.018856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:04.019136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:04.019410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:04.020218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=57122703b71c4fcdaeab2e9d17b1a3a7, user.id=d1850d77c1c940a284a39266ffbbac33) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:07:04.020527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:04.021941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6df11e-b115-4aa6-ad90-7d216a91637c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:04.027586 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 603/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:07:03 2022] GET /identity/v3/role_assignments?user.id=d1850d77c1c940a284a39266ffbbac33&scope.project.id=57122703b71c4fcdaeab2e9d17b1a3a7&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:13.873324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=36 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:14.025524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=80 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:58.865633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24c4-de4d-4e77-9a7a-bf9260c84334 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:58.866371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24c4-de4d-4e77-9a7a-bf9260c84334 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:58.866371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b24c4-de4d-4e77-9a7a-bf9260c84334 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:58.871978 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 598/1201] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:07:58.874832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:58.875502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:58.875502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:58.897025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:07:58.898275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:07:58.995861 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 604/1202] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:07:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:07:59.025734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b24c4-de4d-4e77-9a7a-bf9260c84334 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:59.178745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b24c4-de4d-4e77-9a7a-bf9260c84334 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:59.232664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:59.233538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:59.234029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:59.234327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:59.251989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:59.253792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:07:59.278114 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:07:59.279497 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:07:59.281146 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:07:59.281146 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:07:59.281146 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:07:59.281146 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:07:59.281146 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 599/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:07:59.287515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:59.449571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2333d0-1abd-464d-9c1b-62cbbffc1d17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:59.501760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:59.512002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:59.512649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:59.512934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:59.513214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:59.513949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:07:59.514266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:59.515639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0289b3-ca0c-4e78-8610-b3bae39144f2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:59.528866 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 605/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:07:59.534368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:07:59.601648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:07:59.665611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d4ef0-9839-44b7-8fc1-ca9d76401d27 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:07:59.713145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:07:59.713774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:07:59.714065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:07:59.714339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:07:59.715038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:07:59.716551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec1e31-3a7e-4993-8e69-f9daf175c997 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:07:59.748678 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 600/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Sun Jul 31 01:07:59 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:08:01.899246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045737-ad17-41b1-966b-89839c3eb357 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:01.899921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045737-ad17-41b1-966b-89839c3eb357 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:01.899921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa045737-ad17-41b1-966b-89839c3eb357 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:01.901545 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 606/1206] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:08:01.907122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:01.907720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:01.907720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:01.928195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:01.929465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:02.011982 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 601/1207] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:02.036797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045737-ad17-41b1-966b-89839c3eb357 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.162124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa045737-ad17-41b1-966b-89839c3eb357 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:02.205321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:02.205973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.206254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.206576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.218915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:02.224570 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:02.231573 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:02.232743 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 607/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:08:02.235278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.283887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:02.372606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbf3ef-4957-474d-8656-3ed36b450072 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:02.422508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:02.423539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.424054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.424662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.425783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:02.426348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:02.430980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:02.449358 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 602/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:02.450608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.517166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:02.579444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f5677-72df-4085-9e5e-189e4c25227b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:02.628851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:02.629537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.629838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.630103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.642419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:02.643890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:02.662446 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:02.663703 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:02.664730 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:02.664730 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:02.664730 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:02.664730 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:02.666834 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 608/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:02.673013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.787020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:02.790577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3213a-3193-4257-85fd-a2133a8b996e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:02.829735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:02.830505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:02.830790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:02.831096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:02.831843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:02.832195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:02.833678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:02.847996 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 603/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:02.854083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:02.971049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10a1ee-dc58-43ed-b71d-233cf7284b16 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:02.972824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.013647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:03.014565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:03.014840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:03.015208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:03.025112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:03.026839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:03.041575 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:03.042889 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:03.044100 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 609/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:08:03.049193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:03.172823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419a10d-1ba7-43d4-87a6-98584013618c None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:03.213780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:03.214676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:03.215099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:03.215455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:03.216527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:03.216940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:03.218474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:03.239821 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 604/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:03.246770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:03.357982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1186e4c-933c-430c-be6b-fcb7c38b64a9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:03.400242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:03.401013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:03.401332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:03.401689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:03.452689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.500112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:03.502146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:03.631518 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 610/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:08:03.638988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:03.667201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.775950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a806cf-4a82-48ee-ae49-65ffd6901c99 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:03.815541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:03.816216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:03.816502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:03.816776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:03.827437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:03.828923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:03.845041 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:03.846065 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:03.853028 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:03.853028 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:03.853028 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:03.853028 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:03.853028 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 605/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:03.853329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:03.927248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:03.987532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798b96-ae42-4594-ae35-4b0e3ebbdf92 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:04.032213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:04.032787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:04.033111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:04.033459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:04.034390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:04.034747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:04.036437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:04.051984 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 611/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:04.058138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:04.148897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:04.192988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fa8f-3bc2-4197-99a1-f01a962a6be3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:04.239716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:04.240444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:04.240733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:04.241014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:04.248964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:04.250412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:04.264763 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:04.265899 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:04.271878 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 606/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:04.274717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:04.395670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1e6a-d089-47c8-bea4-ab854fbfd67e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:04.434811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:04.458806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:04.459522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:04.459810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:04.460111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:04.460882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:04.461276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:04.463263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26102ccd-a0bd-47a8-b50f-0baad2af5d03 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:04.478991 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 612/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:04.486124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:04.603374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8da72-a1b6-4eab-86be-6f52b85bd8e0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:04.637819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:04.644333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:04.644962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:04.645247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:04.645534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:04.646369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=fcf777bc227f4dca8be60a22026d1b08) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:04.646623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:04.648132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80088f0-7ce4-4005-ac59-4345222d4e4d None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:04.655219 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 607/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:08:04 2022] GET /identity/v3/role_assignments?user.id=fcf777bc227f4dca8be60a22026d1b08&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:06.809838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd17-db8c-4a83-9709-628ac663aee6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:06.810353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd17-db8c-4a83-9709-628ac663aee6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:06.810353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd17-db8c-4a83-9709-628ac663aee6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:06.811683 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 613/1220] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:06.816974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:06.817441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:06.817545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:06.837254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:06.838460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:06.907206 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 608/1221] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:06.929844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fd17-db8c-4a83-9709-628ac663aee6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.038743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fd17-db8c-4a83-9709-628ac663aee6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.073374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.074063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.074268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.074539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.084894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:07.090571 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:07.091590 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:07.092612 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 614/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:07.098411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.202534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce6ba-429c-43e9-9b54-0248d0096157 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.230061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.243626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.244287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.244571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.244845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.245606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] RBAC: Adding query filter params (name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:07.246002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.247450 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.257150 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 609/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:07.263790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.313026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.377504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ac6cc-5104-4500-b64a-b14c466f635e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.416567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.417300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.417591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.417911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.431694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.433227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:07.449298 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:07.450362 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:07.451378 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:07.451378 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:07.451378 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:07.451378 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:07.451378 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 615/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:07.456424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.562272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93fef9-cef1-4939-a4b0-7ecb4a746949 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.598012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.598668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.598951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.599234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.599950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:07.600263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.601654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.614465 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 610/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:07.620625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.720191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.728089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce204c-92ff-4217-8ded-18b69d113d84 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.765388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.766076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.766437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.766762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.774485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.775965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:07.787518 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:07.789023 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:07.790312 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 616/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:07.795840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:07.849359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:07.905269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5eb88-d022-4201-92de-cf3af66bf4d9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:07.941214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:07.941933 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:07.942332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:07.942757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:07.943638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:07.943956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:07.946191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:07.964482 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 611/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:07.970653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:08.083138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef776bf-bdcf-4ea0-8cf5-dfbedf957976 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:08.131271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:08.131977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:08.132264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:08.132572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:08.146029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:08.147676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:08.165747 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:08.167107 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:08.168258 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:08.168258 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:08.168258 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:08.168258 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:08.168258 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 617/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:08.173504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:08.303807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0635a1f-db34-467c-8906-f375926d4f75 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:08.307511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:08.350639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:08.352252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:08.352568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:08.352849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:08.353853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:08.354164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:08.355587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:08.369517 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 612/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:08.375357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:08.387043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:08.508659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c8d7-c75e-469b-ad00-131c6883e2a6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:08.549183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:08.550418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:08.550821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:08.551098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:08.560178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:08.562172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:08.578842 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:08.580098 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:08.581142 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 618/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:08.587222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:08.717218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d80c3-1a7f-4bf7-a2e0-6dccec57e20b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:08.760159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:08.760845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:08.761130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:08.761441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:08.762295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:08.762662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:08.764416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f226f53-fbd0-4222-8dfa-141b45f9a722 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:08.778669 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 613/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:08.784812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:08.861281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:08.906778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530410-8f96-4289-8d7e-a17e44db2c05 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:08.953672 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:08.954597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:08.954885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:08.955163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/fcf777bc227f4dca8be60a22026d1b08/roles/8155a4db0b764c1ea915bea5400746cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:08.975481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=fcf777bc227f4dca8be60a22026d1b08, role_id=8155a4db0b764c1ea915bea5400746cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:08.977925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fe4f1-d87b-47b8-98c3-df6622966f76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:09.000415 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 619/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:08:08 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/fcf777bc227f4dca8be60a22026d1b08/roles/8155a4db0b764c1ea915bea5400746cb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:08:11.017637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9306a7-eb7d-4852-a1b8-82f2c0c62536 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.018209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9306a7-eb7d-4852-a1b8-82f2c0c62536 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.018209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9306a7-eb7d-4852-a1b8-82f2c0c62536 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.019548 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 614/1233] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:11.026017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.026448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.026557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.046339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:11.047535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:11.121681 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 620/1234] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:11.150494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9306a7-eb7d-4852-a1b8-82f2c0c62536 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:11.177253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.262130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9306a7-eb7d-4852-a1b8-82f2c0c62536 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:11.301895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:11.302534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.302818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.303148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.315881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:11.321360 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:11.322584 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:11.323527 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 615/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Sun Jul 31 01:08:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:11.328876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:11.381299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.444513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2606-2216-4b48-88c4-56625c27091c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:11.490011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:11.490638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.490922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.491198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.491918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:11.492762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:11.494143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:11.502647 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 621/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Sun Jul 31 01:08:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:11.509046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:11.610425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.628970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f23ea-e3b1-412f-811f-1c398069e889 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:11.670521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:11.671415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.671767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.672169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.688164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:11.689755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:11.707867 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:11.709021 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:11.715326 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:11.715326 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:11.715326 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:11.715326 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:11.715326 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 616/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:11.715667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:11.833924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69407331-cc40-4e69-8173-251a2ee1d5ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:11.847661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:11.888427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:11.889293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:11.889705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:11.890183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:11.890940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:11.891423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:11.893625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:11.907758 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 622/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:08:11.913618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:12.026639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a85d-79ab-469d-9c6c-b34ac8884aa3 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:12.062582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:12.063196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.063474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.063751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.066476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:12.072228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:12.073853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:12.087479 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:12.088723 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:12.089795 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 617/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:12.096469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:12.220117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececbb19-cad6-434e-8db8-761024f45b82 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:12.261203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:12.261859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.262140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.262416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.263316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:12.263630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:12.265101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:12.283920 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 623/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:12.290403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:12.416797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475fdb-2b6a-417a-b572-9553dff95778 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:12.460718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:12.461640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.462861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.462964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.536231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:12.548774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:12.550796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:12.663479 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 618/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:08:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 31 01:08:12.670300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:12.700187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:12.788223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40aad-7154-474f-ac62-4d502da6f16d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:12.828629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:12.829642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:12.830132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:12.830415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:12.843814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:12.845323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:12.862013 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:12.863701 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:12.864653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:12.864653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:12.864653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:12.864653 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:12.864653 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 624/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:08:12.869464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:12.976989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:12.983432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb13b6-f535-4eb6-ac1d-639735fa2667 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:13.023048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:13.023855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:13.024260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:13.024848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:13.025837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:13.026238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:13.028137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:13.046037 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 619/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:13.047289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:13.136160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:13.161378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673343f8-84a6-4c40-b0e8-df7e8a017754 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:13.197265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:13.197904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:13.198188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:13.198463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:13.205089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:13.206542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:13.218968 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:13.220012 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:13.221114 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 625/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:13.226740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:13.348214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13f027-5036-4afe-b0f8-cd92aa92cc96 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:13.391889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:13.392588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:13.392857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:13.393133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:13.393877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:13.394179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:13.395616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930ca1f-4cf4-423b-a2c3-23f819029c15 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:13.410214 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 620/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:13.416981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:13.533402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fbc58-f20c-4cb9-9fb8-1a7ef89ffc9e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:13.573090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:13.573744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:13.574033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:13.574312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:13.575189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] RBAC: Adding query filter params (role.id=8155a4db0b764c1ea915bea5400746cb, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=fcf777bc227f4dca8be60a22026d1b08) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:13.575598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:13.577270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdde02-0f35-4885-b1ad-723e65998da7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:13.584033 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 626/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:08:13 2022] GET /identity/v3/role_assignments?user.id=fcf777bc227f4dca8be60a22026d1b08&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=8155a4db0b764c1ea915bea5400746cb => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:15.660783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eedd5e-26cd-42eb-a06a-cbc5dd66536f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:15.661329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eedd5e-26cd-42eb-a06a-cbc5dd66536f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:15.661329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eedd5e-26cd-42eb-a06a-cbc5dd66536f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:15.662663 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 621/1247] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:15.668490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:15.669028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:15.669119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:15.676244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:15.690359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:15.691765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:15.779436 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 627/1248] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:15.806104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eedd5e-26cd-42eb-a06a-cbc5dd66536f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:15.826881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:15.921164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eedd5e-26cd-42eb-a06a-cbc5dd66536f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:15.958416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:15.959206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:15.959493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:15.959767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:15.972669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:15.977933 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:15.979095 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:15.980020 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 622/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:15.985329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:16.104101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55394b18-152e-4615-9014-00bacc5898d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:16.146945 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:16.153333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:16.154333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:16.154644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:16.155214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:16.156266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:16.156887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:16.158607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:16.169087 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 628/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:16.175100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:16.265508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:16.290534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1e20e-78aa-49bf-b413-6e2580a39429 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:16.329786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:16.330428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:16.330713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:16.330990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:16.342394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:16.343989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:16.359990 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:16.360973 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:16.361871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:16.361871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:16.361871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:16.361871 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:16.365988 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 623/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:16.368380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:16.491894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e7e6-9ff8-4187-8bae-d078916b2aa7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:16.533086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:16.533706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:16.533991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:16.534298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:16.534967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:16.535250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:16.536651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:16.554073 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 629/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:16.555953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:16.670350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364d39-a61e-4609-90bd-82ec57dee4e0 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:16.698541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:16.706762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:16.707412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:16.707699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:16.708007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:16.718054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:16.719783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:16.732598 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:16.734241 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:16.735563 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 624/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:16.739765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:16.796930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:16.852403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366f3e-cf52-40e7-8706-000adada99c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:16.891385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:16.892016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:16.892517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:16.892875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:16.893912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:16.894257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:16.895688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:16.913723 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 630/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:08:16.920016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:17.026928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941c92-067d-4462-936d-e6d794b6ded8 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:17.067367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:17.068047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.068343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.068599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.135730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:17.151485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:17.153007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:17.276295 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 625/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:08:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:17.282223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:17.397319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709bbf2-c4f0-4e7a-9d50-d13ee3357783 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:17.410996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:17.442576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:17.442872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.443003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.443961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.453928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:17.455381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:17.470652 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:17.471553 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:17.472489 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:17.472489 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:17.472489 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:17.472489 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:17.472489 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 631/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:17.478075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:17.576037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:17.589191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c01d7-c495-4b4b-a809-5d363cc16297 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:17.631551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:17.632230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.632505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.632913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.633639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:17.633948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:17.635352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:17.648139 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 626/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:17.654615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:17.758503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68456d5e-ab92-4688-b325-d193f38d636d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:17.794315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:17.795003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.795285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.795557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.802158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:17.803595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:17.815501 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:17.816906 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:17.817800 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 632/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:08:17.823154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:17.926867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ba16-6f58-4870-92c5-3a846f46ab06 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:17.964577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:17.965265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:17.965554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:17.965834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:17.966590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:17.966939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:17.968466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d56e6-dfbc-4add-b39d-800360629eb1 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:17.983622 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 627/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:08:17.989960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:18.016920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:18.098326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0ba5-12bc-447e-ac7d-43befe6ebf77 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:18.138643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:18.139368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:18.139659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:18.139955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:18.140864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=fcf777bc227f4dca8be60a22026d1b08) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:18.141214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:18.142671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397e8a-3e28-4941-a894-0a99611125ad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:18.149687 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 633/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:08:17 2022] GET /identity/v3/role_assignments?user.id=fcf777bc227f4dca8be60a22026d1b08&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:20.138161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c404-9b09-4a7f-9a85-9a5685b16736 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.138689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c404-9b09-4a7f-9a85-9a5685b16736 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.138689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1c404-9b09-4a7f-9a85-9a5685b16736 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.140087 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 628/1261] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:20.145237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.145628 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.145831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.164785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:20.165979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:20.231874 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 634/1262] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:20.254374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1c404-9b09-4a7f-9a85-9a5685b16736 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:20.265988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:20.355280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1c404-9b09-4a7f-9a85-9a5685b16736 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:20.388552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:20.389109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.389389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.389663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.400039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:20.404807 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:20.405868 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:20.406907 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 629/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:20.411846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:20.430433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:20.511656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d5316-ad00-42fd-a05e-828525f2b1d9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:20.545353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:20.545970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.546256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.546536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.547249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:20.547558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:20.548972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:20.557564 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 635/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:20.563297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:20.631746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:20.665114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4f84-5932-4d20-95bc-3859a7a2e845 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:20.697793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:20.698421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.698700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.698971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.709091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:20.710515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:20.724706 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:20.725736 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:20.726758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:20.726758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:20.726758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:20.726758 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:20.726758 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 630/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:20.731715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:20.812523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:20.832005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429f4ea-cadd-4ca2-aa30-b26757936aa9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:20.864873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:20.865479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:20.865762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:20.866041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:20.866730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:20.867680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:20.869220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:20.880564 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 636/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:20.886206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:20.983039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c2ea9-4bdb-48e4-be55-68ef1f5533ff None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.002735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:21.016410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.017036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.017312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.017580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.024927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.026345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:21.037128 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:21.038219 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:21.040016 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 631/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:21.044647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.150508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c1314-bab2-4590-87f4-b4bd188d02c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.186585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.187197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.187477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.187751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.188571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:21.188880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.190303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.198700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:21.207409 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 637/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:21.214139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.311525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5f554-cd33-4a05-8eb8-fc12157bc197 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.344096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.344728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.345015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.345297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.356368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.357806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:21.372833 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:21.373926 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:21.375051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:21.375051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:21.375051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:21.375051 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:21.375051 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 632/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:21.379867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.480206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6ddfe-a2a4-434a-8aee-e432b12bf0b0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.512912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.513528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.513814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.514099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.514789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:21.515098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.516501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.528018 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 638/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:21.533602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.565371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:21.634141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939538fa-8da0-4acf-b8be-d3bac475d190 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.667182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.667810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.668124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.668405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.674872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.676355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:21.688023 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:21.689060 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:21.690195 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 633/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:21.694931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.757121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:21.800686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125210e9-86f6-4b2a-b7d1-014463f17d1f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.833793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.834407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.834692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.834972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.835756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:21.836596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.838294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d1bdd-6799-4c65-a28b-75f23ea9382b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:21.849976 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 639/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:21.856261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:21.944136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:21.953503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05995e3-d7aa-49a7-9200-05e8413b75a9 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:21.985978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:21.986630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:21.986908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:21.987177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] PATH_INFO: `/v3/projects/aefae07b6d4844738304e979c85e4764/users/fcf777bc227f4dca8be60a22026d1b08/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:21.989085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] RBAC: Authorizing `identity:create_grant(project_id=aefae07b6d4844738304e979c85e4764, user_id=fcf777bc227f4dca8be60a22026d1b08, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:21.990501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7474b-8d3c-4ce4-996f-f53d7a82770b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:22.003078 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 634/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Sun Jul 31 01:08:21 2022] PUT /identity/v3/projects/aefae07b6d4844738304e979c85e4764/users/fcf777bc227f4dca8be60a22026d1b08/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:08:23.981161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0cbf9-7819-4619-9ced-83b50d76ce6d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:23.981719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0cbf9-7819-4619-9ced-83b50d76ce6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:23.981719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0cbf9-7819-4619-9ced-83b50d76ce6d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:23.983068 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 640/1274] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:23.988220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:23.988620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:23.988778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.007123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:24.008625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:24.072690 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 635/1275] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:24.097249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0cbf9-7819-4619-9ced-83b50d76ce6d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.200534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0cbf9-7819-4619-9ced-83b50d76ce6d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:24.217763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:24.235289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:24.236262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:24.236543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:24.236816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.246843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 31 01:08:24.251616 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:24.252720 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:24.253728 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 641/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:24.259189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.339974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:24.359464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173603a7-68ab-49bd-9cdb-0001e2656e5c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:24.392606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:24.393211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:24.393494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:24.393770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.394473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:24.394776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:24.396163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:24.404843 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 636/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:24.410467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.508696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec0b1d-820d-406e-aea9-0f2a8aa15547 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:24.541931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:24.542549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:24.542828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:24.543101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.552834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:24.554305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:24.568738 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:24.569777 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:24.571608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:24.571608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:24.571608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:24.571608 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:24.571608 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 642/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:24.576339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.672264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e6e1-0d83-4a4e-a674-7b0d300b059b None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:24.704524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:24.705128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:24.705410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:24.705688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.706369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:24.706675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:24.708064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:24.720384 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 637/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:24.725969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.755641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:24.823505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4e702-dd1a-49d8-8d4e-2505be0154b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:24.856059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:24.856681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:24.856960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:24.857231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:24.864384 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:24.865794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 31 01:08:24.876630 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:24.877752 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:24.878689 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 643/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 31 01:08:24.884214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:24.887926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:24.982161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aad8d-8b32-4f91-9f10-62555db39a31 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.015528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15acab-2290-4956-a163-b374df537075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.016157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15acab-2290-4956-a163-b374df537075 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.016442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15acab-2290-4956-a163-b374df537075 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.016719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15acab-2290-4956-a163-b374df537075 None admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.017503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15acab-2290-4956-a163-b374df537075 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:25.017812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15acab-2290-4956-a163-b374df537075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.019231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15acab-2290-4956-a163-b374df537075 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.036699 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 638/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Sun Jul 31 01:08:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:25.042738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.130600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.141274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee779e-2d01-4040-92ed-983d860b92d9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.173133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.173735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.174014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.174284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.239899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.241343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.326853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.337522 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 644/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 31 01:08:25.343425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15acab-2290-4956-a163-b374df537075 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.404418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.443344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15acab-2290-4956-a163-b374df537075 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.477771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.478408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.478691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.478965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.488916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.490359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 31 01:08:25.505426 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:25.506585 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:25.507765 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 31 01:08:25.507765 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 31 01:08:25.507765 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 31 01:08:25.507765 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:25.507765 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 639/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:25.512501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.607318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc53d8-20e3-4814-9a10-b343b09b1e6e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.640481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.641088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.641367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.641641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.642321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:25.642622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.643990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.654998 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 645/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:25.660556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.757904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aac6c3-170c-4efd-a474-5b4a4a0ad019 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.770902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.791511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.792176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.792461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.792736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.799400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.800861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 31 01:08:25.812043 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:25.813054 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: ERROR keystone.server.flask.application Jul 31 01:08:25.814274 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 640/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:25.818961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:25.868322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:25.918063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d3459-e2d7-4e60-867f-d893ae8888fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:25.951134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:25.951751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:25.952073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:25.952356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:25.953108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:25.953419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:25.954853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcffd767-88d1-474c-a981-61d0a762f594 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:25.967670 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 646/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:25.973653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:26.073040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1bdd9-c51a-4556-9cdb-cf0290a0f77e None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:26.105793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:26.106396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:26.106680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:26.106955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:26.107732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] RBAC: Adding query filter params (role.id=c0cc6a3657bb4e54879b1070a008d44d, scope.project.id=aefae07b6d4844738304e979c85e4764, user.id=fcf777bc227f4dca8be60a22026d1b08) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:26.108136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:26.109552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea1941-a5f7-44cb-b997-c36cf27f17b6 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:26.115139 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 641/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Sun Jul 31 01:08:25 2022] GET /identity/v3/role_assignments?user.id=fcf777bc227f4dca8be60a22026d1b08&scope.project.id=aefae07b6d4844738304e979c85e4764&role.id=c0cc6a3657bb4e54879b1070a008d44d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:28.115011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16242804-316b-446f-ac9f-634821500f5c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.115549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16242804-316b-446f-ac9f-634821500f5c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.115549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16242804-316b-446f-ac9f-634821500f5c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.116987 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 647/1288] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:28.122280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.122714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.122834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.140822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:28.142007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:28.171265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:28.207363 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 642/1289] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:28.230004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16242804-316b-446f-ac9f-634821500f5c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:28.328780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16242804-316b-446f-ac9f-634821500f5c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:28.339903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:28.362803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:28.363437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.363721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.364033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.364689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:28.366096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:28.374910 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:28.376131 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:28.377235 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 648/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:08:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:28.382058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:28.479515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbaf82-bb32-43ed-90ed-1218dfce7246 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:28.513194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:28.513798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.514077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.514351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.515016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:28.515317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:28.516708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd250c1e-afdd-4119-9145-5d9e19b8e00b None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:28.521381 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 643/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Sun Jul 31 01:08:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:28.527914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:28.623980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698ee60-c180-4b4d-b0d1-b97ae9a907c4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:28.656626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:28.657220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:28.657501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:28.657775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:28.658439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:28.658739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:28.660126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b5947-93e4-4790-9a71-ad43e68db770 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:28.664503 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 649/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Sun Jul 31 01:08:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:08:30.636727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bb69-a914-4ca1-b40b-102042609827 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:30.637268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bb69-a914-4ca1-b40b-102042609827 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:30.637268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7bb69-a914-4ca1-b40b-102042609827 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:30.638643 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 644/1293] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:30.643597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb397a0-5c90-4105-a31d-5a715c984e4d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:30.644038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb397a0-5c90-4105-a31d-5a715c984e4d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:30.644189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb397a0-5c90-4105-a31d-5a715c984e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:30.662107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fcb397a0-5c90-4105-a31d-5a715c984e4d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:30.663334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fcb397a0-5c90-4105-a31d-5a715c984e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:30.693099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:30.731261 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 650/1294] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:30.753776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7bb69-a914-4ca1-b40b-102042609827 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:30.783910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:30.854264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7bb69-a914-4ca1-b40b-102042609827 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:30.887814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:30.888442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:30.888723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:30.888991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:30.889671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:30.891016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d6353-6c20-4ee9-824a-d21ebc81134e None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:30.905518 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 645/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Sun Jul 31 01:08:30 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:08:32.883591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d8cc-3112-432d-8fbf-306890d4a05f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:32.884212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d8cc-3112-432d-8fbf-306890d4a05f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:32.884212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5d8cc-3112-432d-8fbf-306890d4a05f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:32.885549 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 651/1296] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:32.890754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:32.891176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:32.891309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:32.908936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:32.910125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:32.981344 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 646/1297] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 31 01:08:33.003971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5d8cc-3112-432d-8fbf-306890d4a05f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:33.106340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5d8cc-3112-432d-8fbf-306890d4a05f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:33.147209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:33.147845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.148159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.148464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.149191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:33.150670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:33.160986 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:33.162240 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:33.163310 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 652/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:08:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:33.168975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:33.187385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:33.265497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d6e0-a8d3-45e3-b908-16f6f2af7820 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:33.300037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:33.300643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.300922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.301193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.301861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:33.302161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:33.303621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:33.308961 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 647/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Sun Jul 31 01:08:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:08:33.314875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:33.346470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:33.413320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea97c-a56f-48ee-91fd-f2d5ed519da9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:33.451989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:33.452625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.452914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.453197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.453959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] RBAC: Adding query filter params (interface=public, service_id=b6940475702b459aa836c25e786618a1, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:33.454273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:33.455640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d8451-ab04-48c0-b37a-17263c2088d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:33.461318 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 653/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Sun Jul 31 01:08:33 2022] GET /identity/v3/endpoints?service_id=b6940475702b459aa836c25e786618a1&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:33.467229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:33.546816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:33.564397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ea8ee-0a5b-4f77-8a31-98a4ee072741 None admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:33.597661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:33.598270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:33.598554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:33.598832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:33.599475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:33.600865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272345d-4d92-489a-8202-25d420be8cea None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:33.608105 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 648/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Sun Jul 31 01:08:33 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:08:35.595389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9246e-44e4-44b8-9792-a8530156d0c9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:35.595909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9246e-44e4-44b8-9792-a8530156d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:35.596069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9246e-44e4-44b8-9792-a8530156d0c9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:35.597335 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 654/1302] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:08:35.602909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:35.603312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:35.603459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:35.621241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:08:35.622419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:08:35.687321 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 649/1303] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:08:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 31 01:08:35.709607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9246e-44e4-44b8-9792-a8530156d0c9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:35.804413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:35.811550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9246e-44e4-44b8-9792-a8530156d0c9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:35.845316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:35.845948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:35.846231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:35.846510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:35.847129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:35.848538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 31 01:08:35.857870 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 31 01:08:35.859034 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 31 01:08:35.860224 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 655/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Sun Jul 31 01:08:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 31 01:08:35.865087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:35.939602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:35.961770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a031-f5af-45a4-a301-9b90d8ddde0c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:35.995688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446be970-6242-41c4-b456-e838056542c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:35.996325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be970-6242-41c4-b456-e838056542c7 None admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:35.996605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be970-6242-41c4-b456-e838056542c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:35.996874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446be970-6242-41c4-b456-e838056542c7 None admin] PATH_INFO: `/v3/services` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:35.997539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be970-6242-41c4-b456-e838056542c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:08:35.997843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be970-6242-41c4-b456-e838056542c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:35.999193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446be970-6242-41c4-b456-e838056542c7 None admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:36.004176 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 650/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Sun Jul 31 01:08:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:08:36.010111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:08:36.112238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db0e2a-e1ea-416d-a0ad-39c2b60539d7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:08:36.151955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:08:36.152554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:08:36.152841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:08:36.153123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:08:36.153834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:08:36.155213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36516122-c0aa-4c2c-b38d-c1d32aa788da None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:08:36.174727 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 656/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:08:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:08:46.001330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=30 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:08:46.170414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.057652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e6d3c-c9fc-40b7-abbb-95feaee41e9d None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.058116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e6d3c-c9fc-40b7-abbb-95feaee41e9d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.058194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e6d3c-c9fc-40b7-abbb-95feaee41e9d None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.059946 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 651/1307] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:39.065221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656932-4e04-4684-ab00-ac05a67c2e5a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.065652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656932-4e04-4684-ab00-ac05a67c2e5a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.065837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d656932-4e04-4684-ab00-ac05a67c2e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.167398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5d656932-4e04-4684-ab00-ac05a67c2e5a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:39.168686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5d656932-4e04-4684-ab00-ac05a67c2e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.292402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 657/1308] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:39.349556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.349849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.350129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.351487 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 652/1309] 10.222.0.47 () {54 vars in 965 bytes} [Sun Jul 31 01:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:39.357543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3568f7-1206-42f7-b891-1f2ce2c100a2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.357840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3568f7-1206-42f7-b891-1f2ce2c100a2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.358122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3568f7-1206-42f7-b891-1f2ce2c100a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.437293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4e3568f7-1206-42f7-b891-1f2ce2c100a2 None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:39.438514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e3568f7-1206-42f7-b891-1f2ce2c100a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.462978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.522592 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 658/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Sun Jul 31 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:39.531458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:39.533458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.663882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b0ea5-c5b0-41b4-8b92-ae3ab1a2937b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:39.750163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:39.750898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:39.751301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:39.751648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:39.753458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:39.812931 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:39.873610 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:39.875205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad7026-8386-4c35-bcc3-a324ec2821b5 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:39.896596 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 653/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:42.287413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:42.287954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:42.287954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:42.289455 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 659/1312] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:42.294915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888937-c574-415e-9c45-9b917c546b19 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:42.295339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888937-c574-415e-9c45-9b917c546b19 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:42.295471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9888937-c574-415e-9c45-9b917c546b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:42.375670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c9888937-c574-415e-9c45-9b917c546b19 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:42.376945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c9888937-c574-415e-9c45-9b917c546b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:42.485367 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 654/1313] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:42.523863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:42.525651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:42.631605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f904cb-b32b-4d65-8509-77faec1aacd9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:42.702445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:42.704867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:42.705558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:42.706039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:42.706527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:42.709057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:42.815600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:42.816982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f1f1a-a8c9-4b38-b0fc-95d9563f665e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:42.835866 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 660/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:45.180307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd972-a133-4e15-acf1-89d38e572f0c None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:45.180894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd972-a133-4e15-acf1-89d38e572f0c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:45.180894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd972-a133-4e15-acf1-89d38e572f0c None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:45.182225 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 655/1315] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:45.187363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68872170-5619-41d0-ae84-fa309464dedd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:45.187748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68872170-5619-41d0-ae84-fa309464dedd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:45.187917 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68872170-5619-41d0-ae84-fa309464dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:45.253220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-68872170-5619-41d0-ae84-fa309464dedd None None] MFA Rules not processed for user `2a3537f72d114efcba7870b8e99dc9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:45.254448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-68872170-5619-41d0-ae84-fa309464dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:45.306276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:45.352017 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 661/1316] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:45.408179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987828af-9804-4560-b211-24dfc2a1525e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:45.408466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987828af-9804-4560-b211-24dfc2a1525e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:45.408742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987828af-9804-4560-b211-24dfc2a1525e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:45.410092 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 656/1317] 10.222.0.47 () {54 vars in 965 bytes} [Sun Jul 31 01:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:09:45.416044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722e3a-2b99-4dc5-bf49-fe1758641bd0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:45.416338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722e3a-2b99-4dc5-bf49-fe1758641bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:45.416623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722e3a-2b99-4dc5-bf49-fe1758641bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:45.493616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-66722e3a-2b99-4dc5-bf49-fe1758641bd0 None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:45.494835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-66722e3a-2b99-4dc5-bf49-fe1758641bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:45.572800 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 662/1318] 10.222.0.47 () {58 vars in 1062 bytes} [Sun Jul 31 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:45.581843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987828af-9804-4560-b211-24dfc2a1525e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:45.583926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-987828af-9804-4560-b211-24dfc2a1525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:45.593898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:45.688372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987828af-9804-4560-b211-24dfc2a1525e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:45.760453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:45.760990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:45.761268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:45.761541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:45.763145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:45.823567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:45.872838 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:45.874273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9816c54-c4b4-4d08-af90-8426bb5c416f service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:45.892500 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 657/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:48.873763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:48.874327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:48.874432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:48.875707 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 663/1320] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:48.881015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6aa3-eb68-42e3-99aa-b613cfaf220b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:48.881433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6aa3-eb68-42e3-99aa-b613cfaf220b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:48.881576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d6aa3-eb68-42e3-99aa-b613cfaf220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:48.949495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7c9d6aa3-eb68-42e3-99aa-b613cfaf220b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:48.950709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7c9d6aa3-eb68-42e3-99aa-b613cfaf220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:49.045642 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 658/1321] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:49.084723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:49.086314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:49.138899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:49.191292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f98c2e-118e-456c-9076-622b50ca65ca None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:49.263175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:49.263796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:49.264111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:49.264391 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:49.266012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:49.360438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:49.374536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:49.376022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ae71a-672e-44eb-9b04-3d544908c297 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:49.393550 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 664/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:52.119311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.119847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.119847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.121336 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 659/1323] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:52.126702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de51fe-4d51-4d42-9332-72fc407e8740 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.127118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de51fe-4d51-4d42-9332-72fc407e8740 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.127262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de51fe-4d51-4d42-9332-72fc407e8740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.195886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a5de51fe-4d51-4d42-9332-72fc407e8740 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:52.197121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5de51fe-4d51-4d42-9332-72fc407e8740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.306149 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 665/1324] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:52.344608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:52.346279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.368133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:52.460906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f527-eb39-4758-b0dd-2dffd343210f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:52.534307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:52.534924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:52.535205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:52.535478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:52.537222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:52.610236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:52.651458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:52.652902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e720b2a-69e5-4a5e-b170-d0b6ffa17e9a service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:52.670901 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 660/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:54.813238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:54.813749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:54.813749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:54.815111 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 666/1326] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:54.820783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dbc09-a27a-4803-ac5d-99cc18157777 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:54.821216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dbc09-a27a-4803-ac5d-99cc18157777 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:54.821342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dbc09-a27a-4803-ac5d-99cc18157777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:54.887727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e39dbc09-a27a-4803-ac5d-99cc18157777 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:54.888968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e39dbc09-a27a-4803-ac5d-99cc18157777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:54.986117 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 661/1327] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:55.022703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:55.024278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:55.087096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:55.135912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0a2d4-1e21-4e17-b225-380c04dd8fd3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:55.210619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:55.211239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:55.211527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:55.211807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:55.213738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:55.327487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:55.329857 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:55.331591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128c325-5e3a-47e4-8750-bc8125441556 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:55.352115 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 667/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:09:57.422793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:57.423319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:57.423319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:57.424669 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 662/1329] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:09:57.431007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b96e7-9d7e-44fb-aed4-3262197e6d8b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:57.431485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b96e7-9d7e-44fb-aed4-3262197e6d8b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:57.431662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b96e7-9d7e-44fb-aed4-3262197e6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:57.501322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cc9b96e7-9d7e-44fb-aed4-3262197e6d8b None None] MFA Rules not processed for user `2a3537f72d114efcba7870b8e99dc9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:09:57.502593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc9b96e7-9d7e-44fb-aed4-3262197e6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:57.603048 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 668/1330] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:09:57.640908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:09:57.642442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:57.674410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:57.752280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1bd9d-f399-4e06-80e5-73ec96143889 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:09:57.826391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:09:57.827018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:09:57.827308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:09:57.827589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:09:57.829265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:09:57.919419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:09:57.959828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:09:57.961394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7c757-db63-4db0-b2ec-4f1efaf09000 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:09:57.981168 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 663/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:00.259146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:00.259716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:00.259716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:00.261080 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 669/1332] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:00.266110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c086-7641-490d-88aa-7d8928233ba3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:00.266535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c086-7641-490d-88aa-7d8928233ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:00.266676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c086-7641-490d-88aa-7d8928233ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:00.332799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f220c086-7641-490d-88aa-7d8928233ba3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:00.334858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f220c086-7641-490d-88aa-7d8928233ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:00.430159 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 664/1333] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:00.467495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:00.469081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:00.538385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:00.574188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81795b56-9466-4aad-82a6-4cb3b55294b0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:00.650422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:00.651040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:00.651315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:00.651582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:00.653397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:00.766565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:00.768031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e536-c9b1-4cac-bb81-380f7d8cefcd service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:00.779280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:00.788932 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 670/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:02.878687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:02.879213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:02.879307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:02.881199 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 665/1335] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:02.886382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892fdb-736e-4c67-bca8-ee9a458cd60c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:02.886798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892fdb-736e-4c67-bca8-ee9a458cd60c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:02.886946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84892fdb-736e-4c67-bca8-ee9a458cd60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:02.951750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-84892fdb-736e-4c67-bca8-ee9a458cd60c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:02.952991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-84892fdb-736e-4c67-bca8-ee9a458cd60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:03.048791 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 671/1336] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:03.090065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:03.091631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:03.133753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:03.198612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b2f13-530a-4698-8bad-45a8e758b3ab None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:03.271885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:03.272527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:03.272812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:03.273090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:03.274707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:03.357528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:03.383683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:03.385206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc524988-1375-40aa-9aac-f447ae4cbd6e service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:03.403435 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 666/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:05.903108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620582a7-a61c-4333-9607-50077f182403 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:05.903717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620582a7-a61c-4333-9607-50077f182403 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:05.903717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620582a7-a61c-4333-9607-50077f182403 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:05.905065 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 672/1338] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:05.910159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923904-5dfe-4b15-9607-917f122c611d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:05.910587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923904-5dfe-4b15-9607-917f122c611d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:05.910734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923904-5dfe-4b15-9607-917f122c611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:05.977159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-32923904-5dfe-4b15-9607-917f122c611d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:05.978379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-32923904-5dfe-4b15-9607-917f122c611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:06.078119 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 667/1339] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:06.117601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620582a7-a61c-4333-9607-50077f182403 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:06.119267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-620582a7-a61c-4333-9607-50077f182403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:06.195031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:06.224606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620582a7-a61c-4333-9607-50077f182403 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:06.298738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:06.299366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:06.299652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:06.299959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:06.302263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:06.410301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:06.412383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92316016-b49e-4a78-bec5-1daf25e033f8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:06.430630 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 673/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:10:10.467683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:10.468186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:10.468305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:10.469637 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 668/1341] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:10:10.475093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409d718-ae1f-4bb1-816b-4a4c528abea6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:10.475489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409d718-ae1f-4bb1-816b-4a4c528abea6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:10.475676 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409d718-ae1f-4bb1-816b-4a4c528abea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:10.481163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:10.542956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c409d718-ae1f-4bb1-816b-4a4c528abea6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:10.544206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c409d718-ae1f-4bb1-816b-4a4c528abea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:10.640936 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 674/1342] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:10.680878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:10.682416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:10.732061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:10.787083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216be09-e9cd-4411-a94b-263f25ea4f8f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:10.864718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:10.865280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:10.865581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:10.865860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:10.867497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:10.967777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:10.985285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:10.986746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81685-4d47-4714-bd3a-5c7b8392028f service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:11.006475 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 669/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:13.594750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:13.595319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:13.595319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:13.596688 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 675/1344] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:13.602611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170beaf-be2a-47f3-b953-1cfd897a52f4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:13.603028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170beaf-be2a-47f3-b953-1cfd897a52f4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:13.603195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170beaf-be2a-47f3-b953-1cfd897a52f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:13.677927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c170beaf-be2a-47f3-b953-1cfd897a52f4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:13.679376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c170beaf-be2a-47f3-b953-1cfd897a52f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:13.787153 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 670/1345] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:13.827053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:13.828807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:13.923054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:13.940330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a800e23-3c0d-484b-92ee-512f3189ec76 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:14.016903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:14.017524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:14.017813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:14.018094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:14.019717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:14.134353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:14.135856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262710d-4d07-4487-af19-6df5f6f13a41 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:14.155907 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 676/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:18.201665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:18.202267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:18.202267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:18.203549 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 671/1347] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:18.210789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87586fc0-c6f4-4a28-ae66-c6af7b8dada4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:18.211262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87586fc0-c6f4-4a28-ae66-c6af7b8dada4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:18.211721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87586fc0-c6f4-4a28-ae66-c6af7b8dada4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:18.233028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:18.287454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-87586fc0-c6f4-4a28-ae66-c6af7b8dada4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:18.288732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-87586fc0-c6f4-4a28-ae66-c6af7b8dada4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.389848 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 677/1348] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:18.429671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:18.431289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.492861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:18.564865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d30491-da44-49a5-be8e-ebaa7c727603 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:18.657217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:18.657941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:18.659249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:18.659249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:18.661746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:18.789198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:18.794659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:18.796689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7bafa-c756-44aa-8123-ddd9b250abe0 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:18.817496 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 672/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:23.710423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d526-414d-4cad-bd52-de335a43d048 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:23.710910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d526-414d-4cad-bd52-de335a43d048 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:23.711233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289d526-414d-4cad-bd52-de335a43d048 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:23.713643 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 678/1350] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:23.720836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6029ef-60bc-41c0-bfe5-43b381d9bb03 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:23.721282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6029ef-60bc-41c0-bfe5-43b381d9bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:23.721472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6029ef-60bc-41c0-bfe5-43b381d9bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:23.867847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-af6029ef-60bc-41c0-bfe5-43b381d9bb03 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:23.869436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-af6029ef-60bc-41c0-bfe5-43b381d9bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:23.994203 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 673/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:28.200169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb956-44ac-4fc6-94ac-c015c7aa0594 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:28.200693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb956-44ac-4fc6-94ac-c015c7aa0594 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:28.200989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb956-44ac-4fc6-94ac-c015c7aa0594 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:28.202713 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 679/1352] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:28.208372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de95c-ee5d-46b7-82f7-989e898125a9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:28.208864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de95c-ee5d-46b7-82f7-989e898125a9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:28.208948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de95c-ee5d-46b7-82f7-989e898125a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:28.266622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:28.292083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d30de95c-ee5d-46b7-82f7-989e898125a9 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:28.293368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d30de95c-ee5d-46b7-82f7-989e898125a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:28.387811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=59 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:28.411270 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 674/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:29.793103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d5d-b453-4e55-90d1-b3a130e4d7cc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:29.793630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d5d-b453-4e55-90d1-b3a130e4d7cc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:29.793630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832d5d-b453-4e55-90d1-b3a130e4d7cc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:29.795013 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 680/1354] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:29.800001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03015a-270f-47ed-8d91-82311e27ec52 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:29.800408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03015a-270f-47ed-8d91-82311e27ec52 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:29.801249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03015a-270f-47ed-8d91-82311e27ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:29.879421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-af03015a-270f-47ed-8d91-82311e27ec52 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:29.880656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-af03015a-270f-47ed-8d91-82311e27ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:29.927406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:30.004542 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 675/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:33.421399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8209-8d6e-45f3-a8b6-75f6f2d0630e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.422351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8209-8d6e-45f3-a8b6-75f6f2d0630e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.422841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c8209-8d6e-45f3-a8b6-75f6f2d0630e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:33.429158 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 681/1356] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:33.430602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa397-67eb-41be-aa8c-3143c6cb09f9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.431022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa397-67eb-41be-aa8c-3143c6cb09f9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.431201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa397-67eb-41be-aa8c-3143c6cb09f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:33.521727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d6bfa397-67eb-41be-aa8c-3143c6cb09f9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:33.522956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d6bfa397-67eb-41be-aa8c-3143c6cb09f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:33.627804 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 676/1357] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:33.683752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.684572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.685079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:33.687378 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 682/1358] 10.222.0.47 () {54 vars in 962 bytes} [Sun Jul 31 01:10:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:33.697491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039cdc-8127-42be-ba23-479cf66c829b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:33.697791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039cdc-8127-42be-ba23-479cf66c829b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:33.698196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039cdc-8127-42be-ba23-479cf66c829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:33.715250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:33.779165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-90039cdc-8127-42be-ba23-479cf66c829b None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:33.780597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-90039cdc-8127-42be-ba23-479cf66c829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:33.902679 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 677/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Sun Jul 31 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:33.910845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:33.912937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:34.072802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2eb3d-dc74-4017-a4e0-cae8aa7eaf08 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:34.150454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:34.193881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:34.194414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:34.194698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:34.194974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:34.196655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:34.295551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:34.297196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ff784-ef48-4194-b8a4-adf98215b3f8 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:34.316323 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 683/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:36.563788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:36.564546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:36.564546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:36.566358 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 678/1361] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:36.571724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae4c6-4da5-4bc6-b130-4141080db19f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:36.572302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae4c6-4da5-4bc6-b130-4141080db19f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:36.572468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ae4c6-4da5-4bc6-b130-4141080db19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:36.642923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-790ae4c6-4da5-4bc6-b130-4141080db19f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:36.644674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-790ae4c6-4da5-4bc6-b130-4141080db19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:36.685527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:36.748922 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 684/1362] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:36.792656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:36.794158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:36.872924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:36.972947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d720751-063b-4bf0-9869-a558a3e830cf None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:37.102700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:37.103233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:37.103557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:37.103891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:37.106857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:37.132939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:37.211824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:37.214102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aef11-a3b7-4d81-b5a3-3a482319e3a0 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:37.235600 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 679/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:39.594586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02ea0-c28d-4e99-a7f2-7a2004403ba3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.595497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02ea0-c28d-4e99-a7f2-7a2004403ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.595789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02ea0-c28d-4e99-a7f2-7a2004403ba3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.598038 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 685/1364] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:39.603663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff9d7-67e6-41d6-aa07-550c44c70a33 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.604228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff9d7-67e6-41d6-aa07-550c44c70a33 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.604476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff9d7-67e6-41d6-aa07-550c44c70a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.682845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-80fff9d7-67e6-41d6-aa07-550c44c70a33 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:39.684152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-80fff9d7-67e6-41d6-aa07-550c44c70a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:39.798469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:39.808429 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 680/1365] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:39.849203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.849412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.849959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.851384 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 686/1366] 10.222.0.47 () {54 vars in 962 bytes} [Sun Jul 31 01:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:39.857019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a050-7123-4a92-8c00-21092a92c4db None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:39.857400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a050-7123-4a92-8c00-21092a92c4db None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:39.857745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326a050-7123-4a92-8c00-21092a92c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:39.938582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9326a050-7123-4a92-8c00-21092a92c4db None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:39.939802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9326a050-7123-4a92-8c00-21092a92c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:40.066236 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 681/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Sun Jul 31 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:40.073682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:40.075211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:40.234678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74a2f-21bc-4ab9-b9a6-4edc805bbe10 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:40.257470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:40.358213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:40.358836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:40.359120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:40.359398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:40.361105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:40.464729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:40.466336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed74b38-4c1d-4179-8add-b61639945e36 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:40.486206 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 687/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:41.603848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28279a-7ef0-4e5b-bbd1-ad6837157ee8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:41.604447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28279a-7ef0-4e5b-bbd1-ad6837157ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:41.604447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28279a-7ef0-4e5b-bbd1-ad6837157ee8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:41.605958 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 682/1369] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:41.610963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc27aa-1643-44be-9f9c-42beecaea66f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:41.611398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc27aa-1643-44be-9f9c-42beecaea66f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:41.611569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc27aa-1643-44be-9f9c-42beecaea66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:41.646724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:41.687463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f2dc27aa-1643-44be-9f9c-42beecaea66f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:41.688732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2dc27aa-1643-44be-9f9c-42beecaea66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:41.795015 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 688/1370] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:42.145501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:42.145501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:42.145501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:42.145983 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 683/1371] 10.222.0.47 () {54 vars in 964 bytes} [Sun Jul 31 01:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:42.151189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182cdbe-1939-4afc-9c24-c0ab0e8c60a4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:42.151478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182cdbe-1939-4afc-9c24-c0ab0e8c60a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:42.151757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182cdbe-1939-4afc-9c24-c0ab0e8c60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:42.234043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0182cdbe-1939-4afc-9c24-c0ab0e8c60a4 None None] MFA Rules not processed for user `8d1d0d00aea849cb97808332cb98cfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:42.235259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0182cdbe-1939-4afc-9c24-c0ab0e8c60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:42.287149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:42.321436 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 689/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Sun Jul 31 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:42.328926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:42.330489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:42.384563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:42.450655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68408364-cbbd-44b8-8038-9d784abdb5f1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:42.530151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:42.530773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:42.531056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:42.531332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:42.532986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:42.601402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a97866-e8a9-4326-8dda-b9e4f85a637c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:42.601710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a97866-e8a9-4326-8dda-b9e4f85a637c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:42.601973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a97866-e8a9-4326-8dda-b9e4f85a637c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:42.604103 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 690/1373] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:42.608757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af53-30ec-4f75-8f26-e0508894bc2a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:42.609049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af53-30ec-4f75-8f26-e0508894bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:42.609330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9af53-30ec-4f75-8f26-e0508894bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:42.645045 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:42.662597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:42.664084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:42.683292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-02e9af53-30ec-4f75-8f26-e0508894bc2a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:42.683771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-02e9af53-30ec-4f75-8f26-e0508894bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:42.692572 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 684/1374] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:42.817125 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 691/1375] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:10:42.860958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:42.862786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:42.976318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68a47e-d9d4-4286-b47b-7797f6691124 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:43.099011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:43.108091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:43.108888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:43.109294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:43.109649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:43.111455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:43.207022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:43.208749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a1ad8-068c-42cc-baf2-5a9c81d55422 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:43.226919 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 685/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:45.281487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:45.282011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:45.282011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:45.288003 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 692/1377] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:45.289523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee80b-6c8f-4b1d-b172-4051300f4400 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:45.290295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee80b-6c8f-4b1d-b172-4051300f4400 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:45.290735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eee80b-6c8f-4b1d-b172-4051300f4400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:45.362878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b2eee80b-6c8f-4b1d-b172-4051300f4400 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:45.364171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b2eee80b-6c8f-4b1d-b172-4051300f4400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:45.426763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:45.466886 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 686/1378] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:45.511218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:45.512909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:45.576196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:45.680059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7dd8-15c4-4bee-a454-fcbeb1665603 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:45.802410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:45.802930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:45.803217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:45.803497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:45.805196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:45.816777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:45.899435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:45.901322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce255ec-43c0-460f-b8a6-00fdd82b1ce5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:45.919761 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 693/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:47.982590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:47.983116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:47.983230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:47.984691 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 687/1380] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:47.990324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906e8e-f7de-41a9-9684-e3fd55b2a839 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:47.990753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906e8e-f7de-41a9-9684-e3fd55b2a839 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:47.990924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906e8e-f7de-41a9-9684-e3fd55b2a839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:48.065449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c9906e8e-f7de-41a9-9684-e3fd55b2a839 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:48.066683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9906e8e-f7de-41a9-9684-e3fd55b2a839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:48.168747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:48.186097 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 694/1381] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:48.229061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:48.230574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:48.400561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10746-62b4-445d-b516-ab7d5099ba0f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:48.457620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:48.527080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:48.527699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:48.528003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:48.528279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:48.529878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:48.646422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:48.648237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b6a81-26db-4b92-8264-cc95ec42163a service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:48.669215 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 688/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:50.744548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:50.745081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:50.745081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:50.746432 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 695/1383] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:50.753368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566750-32e7-4acc-9a61-92c70568b4ce None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:50.754054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566750-32e7-4acc-9a61-92c70568b4ce None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:50.754054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52566750-32e7-4acc-9a61-92c70568b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:50.824230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-52566750-32e7-4acc-9a61-92c70568b4ce None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:50.825467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-52566750-32e7-4acc-9a61-92c70568b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:50.827555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:50.943539 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 689/1384] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:50.995509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:50.997429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:51.160518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e9ec7-58b7-461c-9a85-82b30e2f2cbe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:51.242290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:51.305489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:51.306010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:51.306289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:51.306563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:51.308242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:51.404930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:51.407004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5652-dcbe-46a7-80e7-3e1730076d7b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:51.431600 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 696/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:53.493868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:53.494389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:53.494482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:53.495867 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 690/1386] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:53.501423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4527c-78e4-475b-9ab4-bc509a14dad1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:53.501938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4527c-78e4-475b-9ab4-bc509a14dad1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:53.502681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4527c-78e4-475b-9ab4-bc509a14dad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:53.570601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5bb4527c-78e4-475b-9ab4-bc509a14dad1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:53.571331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5bb4527c-78e4-475b-9ab4-bc509a14dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:53.599688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:53.683647 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 697/1387] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:53.735860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:53.737714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:53.877719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:53.899142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe5b59-dd9b-49ed-af8c-4a86297faa73 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:54.028432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:54.029008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:54.029304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:54.029580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:54.031230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:54.132672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:54.134281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76333005-5f1d-4afe-9c15-1655df9d4637 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:54.139387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:54.156034 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 691/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:10:56.336798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:56.337699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:56.337699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:56.338983 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 698/1389] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:56.344161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8166-1b84-4f72-a07c-17cc60ac5294 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:56.344614 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8166-1b84-4f72-a07c-17cc60ac5294 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:56.344725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c8166-1b84-4f72-a07c-17cc60ac5294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:56.413321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a13c8166-1b84-4f72-a07c-17cc60ac5294 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:56.414531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a13c8166-1b84-4f72-a07c-17cc60ac5294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:56.515158 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 692/1390] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:56.559731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:56.561298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:56.710780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74ce1b-480b-4bfa-9944-62c1d4a013d8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:56.720309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:56.829369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa482995-6391-499f-bad6-16008014af55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:56.830824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482995-6391-499f-bad6-16008014af55 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:56.831266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482995-6391-499f-bad6-16008014af55 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:56.831552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482995-6391-499f-bad6-16008014af55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:56.833218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aa482995-6391-499f-bad6-16008014af55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:56.926378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa482995-6391-499f-bad6-16008014af55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:56.927891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa482995-6391-499f-bad6-16008014af55 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:56.946592 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 699/1391] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:57.815180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ab2a-5e06-4422-afdc-7d0f4ba50ba3 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:57.815749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ab2a-5e06-4422-afdc-7d0f4ba50ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:57.815749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6ab2a-5e06-4422-afdc-7d0f4ba50ba3 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:57.817099 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 693/1392] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:57.822558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155ace-8eef-4b3c-9c79-6ec210c8146b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:57.823007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155ace-8eef-4b3c-9c79-6ec210c8146b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:57.823181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155ace-8eef-4b3c-9c79-6ec210c8146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:57.839514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:57.890027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1155ace-8eef-4b3c-9c79-6ec210c8146b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:57.891250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1155ace-8eef-4b3c-9c79-6ec210c8146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:57.990453 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 700/1393] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:58.046855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:58.047145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:58.047426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:58.048866 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 694/1394] 10.222.0.47 () {54 vars in 966 bytes} [Sun Jul 31 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:58.054193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34757c2-e51b-4713-b07e-c016b2f149bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:58.054562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34757c2-e51b-4713-b07e-c016b2f149bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:58.054944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34757c2-e51b-4713-b07e-c016b2f149bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:58.136380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b34757c2-e51b-4713-b07e-c016b2f149bf None None] MFA Rules not processed for user `ce143d790f1745f2b66494b85f1fb66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:58.137602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b34757c2-e51b-4713-b07e-c016b2f149bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:58.173139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:58.217314 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 701/1395] 10.222.0.47 () {58 vars in 1063 bytes} [Sun Jul 31 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:58.225540 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:58.227069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:58.301246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:58.333397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf95bb-1b94-4eb2-bcc1-baf52031c0dc None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:58.408549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:58.409086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:58.409369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:58.409643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:58.411288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:58.531396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:58.532916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33bff1-a300-4c0d-a305-98872e4edf7d service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:58.548433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:58.552720 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 695/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:58.977826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:58.978361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:58.978481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:58.979788 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 702/1397] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:10:58.985239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b57-96da-4ff3-90c0-0f6afc2da7f6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:58.985635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b57-96da-4ff3-90c0-0f6afc2da7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:58.985956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e7b57-96da-4ff3-90c0-0f6afc2da7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.054668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5a1e7b57-96da-4ff3-90c0-0f6afc2da7f6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:59.055893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5a1e7b57-96da-4ff3-90c0-0f6afc2da7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.163150 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 696/1398] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:59.209373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:59.211046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.308398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5134-a44c-4f0d-a0e7-af9c2426ce7b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.308695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5134-a44c-4f0d-a0e7-af9c2426ce7b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.308976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a5134-a44c-4f0d-a0e7-af9c2426ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.366033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa7341-645f-4cf3-8926-726b96ec8d07 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:59.377169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6f7a5134-a44c-4f0d-a0e7-af9c2426ce7b None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:59.378386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6f7a5134-a44c-4f0d-a0e7-af9c2426ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.406242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:59.410071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:59.470759 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 697/1399] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:10:59.491897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:59.492580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.492864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.493140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.494990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.520865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7616-c662-4673-91a4-2da8f69a45cd None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.521234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7616-c662-4673-91a4-2da8f69a45cd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.522170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf7616-c662-4673-91a4-2da8f69a45cd None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.523793 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 698/1400] 10.222.0.47 () {54 vars in 943 bytes} [Sun Jul 31 01:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:10:59.529739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2674a-3167-4ba5-a10c-f339796d6728 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.530029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2674a-3167-4ba5-a10c-f339796d6728 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.530311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2674a-3167-4ba5-a10c-f339796d6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.600759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:10:59.602363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:10:59.618622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-08e2674a-3167-4ba5-a10c-f339796d6728 None None] MFA Rules not processed for user `4d58f02ebba84bf0b29ef054b7d8cc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:10:59.619859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-08e2674a-3167-4ba5-a10c-f339796d6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.621236 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 703/1401] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:10:59.739951 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 699/1402] 10.222.0.47 () {58 vars in 1040 bytes} [Sun Jul 31 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:10:59.749652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:10:59.750897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:10:59.810976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:10:59.855244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505f230-0ce9-436c-93c3-f4a50c9d1e2d service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:10:59.963817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:10:59.964475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:10:59.964759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:10:59.965040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:10:59.966716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:00.050540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:00.054685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:00.056344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9294fc1-3016-4e52-8518-00f2b9973b2c service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:00.064745 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 704/1403] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:10:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:11:01.698696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:01.699199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:01.699199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:01.704342 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 700/1404] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:11:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:01.705890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01843-8b7f-4cae-a277-c57587a78585 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:01.706306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01843-8b7f-4cae-a277-c57587a78585 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:01.706452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d01843-8b7f-4cae-a277-c57587a78585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:01.778398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-27d01843-8b7f-4cae-a277-c57587a78585 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:01.779639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27d01843-8b7f-4cae-a277-c57587a78585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:01.892670 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 705/1405] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:11:01.940332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:01.941927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:01.944951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:02.108425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996f3ef-5c8f-40a4-8f71-56604e3aaaee None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:02.195864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:02.244002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:02.244622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:02.244903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:02.245179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:02.246799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:02.342315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:02.344051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de704e0-bffa-47be-94aa-a79730433fd9 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:02.364816 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 701/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:04.437250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:04.437782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:04.437885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:04.443461 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 706/1407] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:04.445108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584c4d-df96-4290-81ca-7f236520b715 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:04.445561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584c4d-df96-4290-81ca-7f236520b715 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:04.445749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584c4d-df96-4290-81ca-7f236520b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:04.516735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-96584c4d-df96-4290-81ca-7f236520b715 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:04.518977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-96584c4d-df96-4290-81ca-7f236520b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:04.565622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:04.639963 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 702/1408] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:04.680325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:04.682084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:04.771365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:04.861669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7783-f745-4283-a0a5-71aaca132be1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:04.987252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:04.987873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:04.988182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:04.988566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:04.990209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:05.028925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:05.088876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:05.090486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d870e-096c-4705-9fee-c53d099c987c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:05.109727 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 707/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:14.634411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=26 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:15.106598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=30 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:22.714181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ac2-d0bb-42d0-b9b3-7dace1cc85db None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:22.714699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ac2-d0bb-42d0-b9b3-7dace1cc85db None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:22.714699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e61ac2-d0bb-42d0-b9b3-7dace1cc85db None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:22.716010 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 703/1410] 10.222.0.47 () {54 vars in 918 bytes} [Sun Jul 31 01:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:22.721247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa44e-7fb2-47f0-b0cb-fcfcf0624ed3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:22.721716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa44e-7fb2-47f0-b0cb-fcfcf0624ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:22.721817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa44e-7fb2-47f0-b0cb-fcfcf0624ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:22.799191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1faaa44e-7fb2-47f0-b0cb-fcfcf0624ed3 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:22.800434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1faaa44e-7fb2-47f0-b0cb-fcfcf0624ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:22.905963 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 708/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Jul 31 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:22.920898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5cc00-b351-48dc-9ab6-1bd5599a7542 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:22.921215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5cc00-b351-48dc-9ab6-1bd5599a7542 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:22.921494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5cc00-b351-48dc-9ab6-1bd5599a7542 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:22.923398 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 704/1412] 10.222.0.47 () {54 vars in 918 bytes} [Sun Jul 31 01:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:22.928100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509631f-15eb-47eb-a238-36be9e2457b8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:22.928393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509631f-15eb-47eb-a238-36be9e2457b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:22.928674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509631f-15eb-47eb-a238-36be9e2457b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:23.007044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:23.009897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8509631f-15eb-47eb-a238-36be9e2457b8 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:23.011662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8509631f-15eb-47eb-a238-36be9e2457b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:23.128907 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 709/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Jul 31 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:25.591620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:25.592165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:25.592279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:25.593740 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:25.599070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e2c-3e70-4167-baa5-d8bb780bf490 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:25.599489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e2c-3e70-4167-baa5-d8bb780bf490 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:25.599634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b55e2c-3e70-4167-baa5-d8bb780bf490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:25.664716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a9b55e2c-3e70-4167-baa5-d8bb780bf490 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:25.665917 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a9b55e2c-3e70-4167-baa5-d8bb780bf490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:25.720545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:25.762949 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:25.806571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:25.808109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:25.954831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e06c15-9d11-4c25-a10c-2ddea3c568e8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:26.028801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:26.069544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:26.070165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:26.070448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:26.070725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:26.072390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:26.163462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:26.165121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d3526-b6c2-4db3-a056-2cad5bcf53aa service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:26.183732 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 706/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:27.082140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:27.082679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:27.082679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:27.084076 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:27.089149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a925e-d991-48e0-983b-5631f3d8ec60 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:27.089556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a925e-d991-48e0-983b-5631f3d8ec60 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:27.089708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a925e-d991-48e0-983b-5631f3d8ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:27.165499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ca3a925e-d991-48e0-983b-5631f3d8ec60 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:27.166712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ca3a925e-d991-48e0-983b-5631f3d8ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:27.192950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:27.262864 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:27.414081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:27.415527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:27.563900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022dcf-dee7-4e8f-bc5a-de56314c5d05 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:27.603763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:27.677386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:27.677923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:27.678201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:27.678471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:27.680112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:27.768958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:27.770548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20db0a-3222-43eb-b5d4-9f29930527f6 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:27.788710 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 712/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:28.676576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:28.677092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:28.677200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:28.678513 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:28.683369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22a09-8e1e-4bb9-8d1c-f2137509d4a7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:28.683764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22a09-8e1e-4bb9-8d1c-f2137509d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:28.683927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca22a09-8e1e-4bb9-8d1c-f2137509d4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:28.738184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:28.760203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ca22a09-8e1e-4bb9-8d1c-f2137509d4a7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:28.761396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ca22a09-8e1e-4bb9-8d1c-f2137509d4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:28.857643 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:11:29.014003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:29.015919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:29.161659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a7494-f43b-48d5-b840-a804ad4018ff None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:29.173739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:29.274951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:29.275487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:29.275770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:29.276090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:29.277721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:29.366332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:29.367923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabdf67-d7f8-41a6-85ac-081e0525f714 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:29.386428 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 709/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:30.243901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:30.244478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:30.244478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:30.245964 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:30.252818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cf3c9-5751-4279-8c9c-ec63d1df67fa None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:30.252818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cf3c9-5751-4279-8c9c-ec63d1df67fa None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:30.252818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cf3c9-5751-4279-8c9c-ec63d1df67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:30.273101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:30.334556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-552cf3c9-5751-4279-8c9c-ec63d1df67fa None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:30.335775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-552cf3c9-5751-4279-8c9c-ec63d1df67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:30.438100 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:11:30.590262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:30.591788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:30.702059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:30.737554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9199-b83c-46d8-a46e-2bdf75bf264e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:30.847404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:30.847974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:30.848265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:30.848544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:30.850177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:30.925916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:30.940470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:30.942096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222262dc-44b9-495f-8bb8-09d3e648b1dd service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:30.960126 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 715/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:31.825110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:31.825629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:31.825629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:31.827006 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:31.832783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b796e8-cccc-4007-8af9-3462f37c16ff None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:31.833216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b796e8-cccc-4007-8af9-3462f37c16ff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:31.833350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b796e8-cccc-4007-8af9-3462f37c16ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:31.909751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-97b796e8-cccc-4007-8af9-3462f37c16ff None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:31.910969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97b796e8-cccc-4007-8af9-3462f37c16ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:32.007208 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:32.158384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:32.159853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:32.243198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:32.305683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127fb20-9a15-4725-be1a-296d51e9655a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:32.418173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:32.418710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:32.418991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:32.419278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:32.420917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:32.470722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:32.513039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:32.514642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8255d69-f8b9-42d0-b3aa-194907a74c6d service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:32.532976 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 712/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:33.326034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586776-579c-443d-b896-982cc5f16340 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:33.326603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586776-579c-443d-b896-982cc5f16340 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:33.326603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586776-579c-443d-b896-982cc5f16340 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:33.328288 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:33.333206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ad4-d2a4-4941-bf22-eb7504bc96e8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:33.333606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ad4-d2a4-4941-bf22-eb7504bc96e8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:33.333763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54848ad4-d2a4-4941-bf22-eb7504bc96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:33.410767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-54848ad4-d2a4-4941-bf22-eb7504bc96e8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:33.411998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-54848ad4-d2a4-4941-bf22-eb7504bc96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:33.509720 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:33.660786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586776-579c-443d-b896-982cc5f16340 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:33.662234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e2586776-579c-443d-b896-982cc5f16340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:33.717538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:33.816013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586776-579c-443d-b896-982cc5f16340 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:33.928764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:33.929299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:33.929576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:33.929846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:33.931474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:33.938977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:34.023743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:34.025363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba98de-11c6-4ea5-92e0-eeab1b05829b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:34.043502 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 718/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:34.844171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:34.844742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:34.844742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:34.846108 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:34.850892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249e92-e9c6-484e-9dd8-ee8cf4faa8d0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:34.851326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249e92-e9c6-484e-9dd8-ee8cf4faa8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:34.851460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83249e92-e9c6-484e-9dd8-ee8cf4faa8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:34.927852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-83249e92-e9c6-484e-9dd8-ee8cf4faa8d0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:34.929205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83249e92-e9c6-484e-9dd8-ee8cf4faa8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:34.997128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:35.028841 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:35.177543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:35.178964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:35.196749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:35.325413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40f5a-0fd6-4a79-bf53-10be02dd994e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:35.416260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:35.443324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:35.444225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:35.444511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:35.444793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:35.446439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:35.536203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:35.537849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669aee-324e-401a-a52d-e1c57d8889c5 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:35.556404 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 715/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:36.377504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:36.378045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:36.378045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:36.379402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:36.384256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ee1e-79ad-4bb2-8123-de8a85645944 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:36.384697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ee1e-79ad-4bb2-8123-de8a85645944 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:36.384851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ee1e-79ad-4bb2-8123-de8a85645944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:36.461778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c291ee1e-79ad-4bb2-8123-de8a85645944 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:36.462995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c291ee1e-79ad-4bb2-8123-de8a85645944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:36.504107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:36.559405 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:36.710556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:36.712275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:36.856495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8e37a-7ed9-4ace-9e40-561529d3aff6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:36.910715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:36.969941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:36.970500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:36.970780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:36.971052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:36.972759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:37.062156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:37.063811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60b3e-b049-46cc-afc8-2566fe4d7f41 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:37.081866 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 721/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:37.887055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:37.887612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:37.887612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:37.889003 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:37.894212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e3f0-3a08-4905-a5ff-0274a8ec8d14 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:37.894644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e3f0-3a08-4905-a5ff-0274a8ec8d14 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:37.894755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e3f0-3a08-4905-a5ff-0274a8ec8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:37.972069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d087e3f0-3a08-4905-a5ff-0274a8ec8d14 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:37.973233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d087e3f0-3a08-4905-a5ff-0274a8ec8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:37.975390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:38.072122 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:38.224483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:38.225931 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:38.371371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d781ddc-9d6d-4588-bae1-003ece8868f7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:38.399375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:38.486878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:38.487454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:38.487718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:38.488027 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:38.489676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:38.580178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:38.581770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420430d-820e-49ed-a834-357d9a2d270d service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:38.600920 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 718/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:40.511766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:40.512344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:40.512444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:40.513742 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:40.519457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d23e-9442-4c5d-8486-8efae955e771 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:40.519877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d23e-9442-4c5d-8486-8efae955e771 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:40.520049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120d23e-9442-4c5d-8486-8efae955e771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:40.561444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:40.587186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-3120d23e-9442-4c5d-8486-8efae955e771 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:40.588445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3120d23e-9442-4c5d-8486-8efae955e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:40.683602 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:40.722186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:40.723752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:40.951172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3b73f-7e14-42ae-ade9-6ba315a064c3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:40.984042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:41.025167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:41.025783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:41.026065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:41.026340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:41.027974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:41.136444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:41.137866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb9c2b-8c06-485e-80ed-b52423318f38 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:41.157529 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 724/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:43.370791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:43.371399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:43.371399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:43.372737 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:43.378645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3280c2-a75c-4eb9-ab71-c7efbbddbaba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:43.379090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3280c2-a75c-4eb9-ab71-c7efbbddbaba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:43.379195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3280c2-a75c-4eb9-ab71-c7efbbddbaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:43.445141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5b3280c2-a75c-4eb9-ab71-c7efbbddbaba None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:43.446347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5b3280c2-a75c-4eb9-ab71-c7efbbddbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:43.459735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:43.544415 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:43.583363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:43.584981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:43.689675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634e632-c9b2-43a6-9969-9cd9faee2afe None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:43.702232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:43.765733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:43.766350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:43.766633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:43.766908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:43.768567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:43.878842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:43.880343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21258c-f8d6-4639-a5a5-d9457aaf43ff service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:43.898056 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 721/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:46.201443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:46.202577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:46.202750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:46.204158 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:46.209413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d15f-4259-4369-8a4d-5eea37cb84b0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:46.209818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d15f-4259-4369-8a4d-5eea37cb84b0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:46.209976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d15f-4259-4369-8a4d-5eea37cb84b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:46.257357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:46.275438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6720d15f-4259-4369-8a4d-5eea37cb84b0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:46.276687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6720d15f-4259-4369-8a4d-5eea37cb84b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:46.373111 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:46.413872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:46.415635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:46.519701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc604b9b-0954-4d14-9601-05f48235e19e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:46.559216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:46.593710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:46.594320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:46.594600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:46.594872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:46.596546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:46.707195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:46.708659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874668fb-e20c-4ab9-88bf-3c251660aa48 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:46.727517 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 727/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:48.864355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:48.864917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:48.864917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:48.866317 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:11:48.871470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f603-5903-4742-b56e-8ec31ad2cdab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:48.871895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f603-5903-4742-b56e-8ec31ad2cdab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:48.872037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f603-5903-4742-b56e-8ec31ad2cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:48.938955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ab61f603-5903-4742-b56e-8ec31ad2cdab None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:48.940198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ab61f603-5903-4742-b56e-8ec31ad2cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:48.960061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:49.035832 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:49.074636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:49.076199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:49.184242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09c3a5-ad4f-419e-853e-5e834a201185 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:49.208165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:49.263357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:49.264019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:49.264306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:49.264583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:49.266215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:49.375351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:49.376820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ef57-b3db-448a-b282-394c4326b6a4 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:49.394539 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 724/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:51.485939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:51.486444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:51.486548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:51.487867 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:51.493143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13d03-cf77-4c50-9f49-c8951e5354d7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:51.493595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13d03-cf77-4c50-9f49-c8951e5354d7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:51.493715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13d03-cf77-4c50-9f49-c8951e5354d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:51.678001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:51.681091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-04d13d03-cf77-4c50-9f49-c8951e5354d7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:51.682932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-04d13d03-cf77-4c50-9f49-c8951e5354d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:51.780446 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:11:51.818798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:51.820375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:51.921882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88070f33-a2b3-4b35-b5e3-04883b209039 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:51.971434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:51.996154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:51.996778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:51.997062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:51.997343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:51.999883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:52.108408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:52.109855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef31840-fb09-4188-adf6-e582c7b17d33 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:52.127607 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 730/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:54.203030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:54.203633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:54.203633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:54.204993 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:54.210241 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578329-df75-4239-ab05-d60ab1b8ba7b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:54.210898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578329-df75-4239-ab05-d60ab1b8ba7b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:54.211042 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578329-df75-4239-ab05-d60ab1b8ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:54.277633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-25578329-df75-4239-ab05-d60ab1b8ba7b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:54.278830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-25578329-df75-4239-ab05-d60ab1b8ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:54.308746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:54.375660 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:54.414464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:54.416052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:54.519809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9b6ae-9aec-4115-abcc-8eaec0c9b700 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:54.549606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:54.596211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:54.596829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:54.597111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:54.597378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:54.598985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:54.709506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:54.711203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3f29d-06e3-43ad-bc7e-3259608942fb service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:54.729594 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 727/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:56.768400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:56.768911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:56.768911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:56.770228 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:56.775429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce589113-8602-434e-8efc-c7e4bd88d0ee None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:56.775811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce589113-8602-434e-8efc-c7e4bd88d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:56.776028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce589113-8602-434e-8efc-c7e4bd88d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:56.843847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ce589113-8602-434e-8efc-c7e4bd88d0ee None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:56.845085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ce589113-8602-434e-8efc-c7e4bd88d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:56.853307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:56.943128 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:56.980210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:56.981778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:57.087309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a538e6-b6d1-49b2-a188-4ac676e067c7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:57.143296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:57.161770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:57.162403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:57.162669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:57.162944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:57.164591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:57.281773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:57.283225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f305e-9b2f-4a34-9fc2-b69ddd974463 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:57.301004 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 733/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:11:59.370440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:59.371023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:59.371023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:59.372424 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:11:59.378412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fdbd0-cde7-43eb-ada2-3278bf34ff1a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:59.378863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fdbd0-cde7-43eb-ada2-3278bf34ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:59.378998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fdbd0-cde7-43eb-ada2-3278bf34ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:59.445179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-072fdbd0-cde7-43eb-ada2-3278bf34ff1a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:11:59.446399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-072fdbd0-cde7-43eb-ada2-3278bf34ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:59.485401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:59.544357 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:11:59.582982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:11:59.584675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:59.687072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d55a14-da9d-4baa-9f0a-fc0050699071 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:11:59.723843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:11:59.759477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:11:59.760140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:11:59.760421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:11:59.760692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:11:59.762299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:11:59.869086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:11:59.870518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58147-d062-4448-9ed8-8dbeb6f460ae service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:11:59.888654 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 730/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:01.954144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:01.954719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:01.954719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:01.956161 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:01.961951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc920fe-9ddf-480f-ae5c-2d54b322aaa9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:01.962374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc920fe-9ddf-480f-ae5c-2d54b322aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:01.962561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc920fe-9ddf-480f-ae5c-2d54b322aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.029918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5dc920fe-9ddf-480f-ae5c-2d54b322aaa9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:02.031141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5dc920fe-9ddf-480f-ae5c-2d54b322aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.049817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:02.131450 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:02.169056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:02.171385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.280867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704639-b6b5-4efc-a2ed-83966ce177ee None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:02.349357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:02.357811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:02.358513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:02.358797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:02.359077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:02.360776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:02.471557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:02.473069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc62cf-ca3e-42d8-b761-911c3b0af4ef service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:02.491404 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 736/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:12:04.571282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.571836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.571836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.573227 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:04.578725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fee6-4b32-4587-b670-eb51685f0231 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.579183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fee6-4b32-4587-b670-eb51685f0231 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.579280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fee6-4b32-4587-b670-eb51685f0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.647993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2505fee6-4b32-4587-b670-eb51685f0231 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:04.649210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2505fee6-4b32-4587-b670-eb51685f0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.698929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.749533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:04.786102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:04.787688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:04.890251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1ea6e-bfa4-432c-b2cc-8a7c472f1d10 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:04.938848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:04.965091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:04.965643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:04.965925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:04.967130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:04.968934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:05.078737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:05.080202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cd7fa-6d4a-4b03-ac49-07fb6dac7287 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:05.098623 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 733/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:14.747673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=22 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:15.096337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:25.019986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1665-826d-4a6c-838f-6e1ff3723bea None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:25.020512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1665-826d-4a6c-838f-6e1ff3723bea None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:25.020512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1665-826d-4a6c-838f-6e1ff3723bea None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:25.021814 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 738/1471] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:25.026926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b40ce-f8be-426e-8dd9-ab8fc5ef53ec None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:25.027344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b40ce-f8be-426e-8dd9-ab8fc5ef53ec None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:25.028178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b40ce-f8be-426e-8dd9-ab8fc5ef53ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:25.093867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b94b40ce-f8be-426e-8dd9-ab8fc5ef53ec None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:25.095073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b94b40ce-f8be-426e-8dd9-ab8fc5ef53ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:25.191692 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 734/1472] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:25.275433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:25.275721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:25.276036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:25.277379 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 739/1473] 10.222.0.47 () {54 vars in 966 bytes} [Sun Jul 31 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:25.282165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedaf04-cffb-4017-a6a5-557814f0d21a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:25.282457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedaf04-cffb-4017-a6a5-557814f0d21a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:25.282754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedaf04-cffb-4017-a6a5-557814f0d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:25.360260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-abedaf04-cffb-4017-a6a5-557814f0d21a None None] MFA Rules not processed for user `ce143d790f1745f2b66494b85f1fb66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:25.361459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-abedaf04-cffb-4017-a6a5-557814f0d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:25.382182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:25.440105 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 735/1474] 10.222.0.47 () {58 vars in 1063 bytes} [Sun Jul 31 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:25.447757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:25.449846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:25.552498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ab5b2-4fe2-490b-8576-508b04f9a4bb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:25.624761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:25.625373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:25.625652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:25.625926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:25.627540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:25.682421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:25.740682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:25.742155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d5cf5-605c-43b7-a31c-03a1ba08a2b3 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:25.761340 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 740/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:27.850041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.850569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.850687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.851986 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 736/1476] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:27.858117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e420-a8b8-4d5c-9b44-f58ca68d170d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:27.858570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e420-a8b8-4d5c-9b44-f58ca68d170d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:27.858673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0e420-a8b8-4d5c-9b44-f58ca68d170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:27.924451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e8a0e420-a8b8-4d5c-9b44-f58ca68d170d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:27.925678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8a0e420-a8b8-4d5c-9b44-f58ca68d170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:28.020814 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 741/1477] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:28.044951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:28.046498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:28.172146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c2e74-604d-4866-8ec4-a1a63ed42417 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:28.221996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:28.267892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:28.268556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:28.268832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:28.269100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:28.269821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:28.271531 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:12:28.271531 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:12:28.271531 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:12:28.272726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdda327-8d3a-42dd-a511-e5d63f48277d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:28.291765 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 737/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Sun Jul 31 01:12:28 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:12:30.314298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:30.314897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:30.314897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:30.316316 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 742/1479] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:30.321698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660ebb-c53a-47fc-a65c-13a4396d9eb2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:30.322093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660ebb-c53a-47fc-a65c-13a4396d9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:30.322260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b660ebb-c53a-47fc-a65c-13a4396d9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:30.388351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8b660ebb-c53a-47fc-a65c-13a4396d9eb2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:30.389576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8b660ebb-c53a-47fc-a65c-13a4396d9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:30.490631 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 738/1480] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:30.536871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:30.538597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:30.549594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:30.692328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae3801-d3ac-4aca-90b6-1a03094f7426 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:30.772423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:30.805946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:30.806572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:30.806852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:30.807131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:30.809070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:30.898016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:30.899599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd36c8-fc15-4bd2-86ea-be44f8a3480d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:30.919402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 743/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:33.089653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:33.090219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:33.090219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:33.091585 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 739/1482] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 31 01:12:33.096930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be599f-2471-47c9-a425-4b50ae4bffe5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:33.097354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be599f-2471-47c9-a425-4b50ae4bffe5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:33.097495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be599f-2471-47c9-a425-4b50ae4bffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:33.164491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-58be599f-2471-47c9-a425-4b50ae4bffe5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:33.165715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-58be599f-2471-47c9-a425-4b50ae4bffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:33.212660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:33.264407 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 744/1483] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:33.301080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:33.302675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:33.326909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:33.408635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f525c-d909-41d4-bc9e-cddbcabb332f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:33.482414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:33.483035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:33.483326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:33.483605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:33.485255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:33.559464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:33.594802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:33.596262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1166f3e-141f-4161-87bc-20918c95239c service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:33.617865 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 740/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:35.727624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.728235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.728235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.729527 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 745/1485] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:35.734910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b1b1-6073-4488-a102-dc67af40ab3f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:35.735389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b1b1-6073-4488-a102-dc67af40ab3f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:35.735501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3b1b1-6073-4488-a102-dc67af40ab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:35.801233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-31f3b1b1-6073-4488-a102-dc67af40ab3f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:35.802449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-31f3b1b1-6073-4488-a102-dc67af40ab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:35.902970 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 741/1486] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:35.940799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:35.942329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:36.047387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14d7c-fcdb-4cf0-8fad-e758796e243c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:36.119320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:36.121287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:36.121960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:36.122459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:36.122793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:36.125185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:36.235202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:36.236753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df80619-89b2-4356-81fc-fd11f2811866 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:36.254770 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 746/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:38.381447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:38.382112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:38.382112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:38.383360 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 742/1488] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:38.389023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1814-66fd-47f8-addb-f182bbbeae0b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:38.389441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1814-66fd-47f8-addb-f182bbbeae0b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:38.389592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc1814-66fd-47f8-addb-f182bbbeae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:38.455925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-11cc1814-66fd-47f8-addb-f182bbbeae0b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:38.457176 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-11cc1814-66fd-47f8-addb-f182bbbeae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:38.511495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:38.556847 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 747/1489] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:38.597591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:38.599148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:38.636718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:38.704534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196585-5c59-4495-9677-f4b5c1f744b1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:38.777578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:38.778201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:38.778490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:38.778772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:38.780434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:38.860207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:38.889658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:38.891053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c06f1-c66d-47f7-94de-8b07dd3531dd service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:38.909341 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 743/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:41.163499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:41.164074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:41.164074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:41.165373 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 748/1491] 10.222.0.47 () {54 vars in 926 bytes} [Sun Jul 31 01:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:12:41.171376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2368ab-a434-430e-8a97-6d00677ae442 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:41.171807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2368ab-a434-430e-8a97-6d00677ae442 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:41.171922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2368ab-a434-430e-8a97-6d00677ae442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:41.237486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7b2368ab-a434-430e-8a97-6d00677ae442 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:12:41.238701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7b2368ab-a434-430e-8a97-6d00677ae442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:41.335352 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 744/1492] 10.222.0.47 () {58 vars in 1023 bytes} [Sun Jul 31 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:12:41.375247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:12:41.376862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:41.482503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad939e17-995b-40e5-84b9-946452c6cb45 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:12:41.555215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:12:41.555832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:12:41.556145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:12:41.556424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:12:41.558592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:12:41.567722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:41.667493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:12:41.669091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f96abc-f1ce-462f-b905-e995bdc84b33 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:12:41.687405 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 749/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:12:51.333251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=82 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:12:51.685299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=50 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:08.886302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:08.886878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:08.886878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:08.964669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:08.965791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.061199 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 745/1494] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:09.070392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:09.070883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:09.070992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:09.148607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:09.149821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.248334 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 750/1495] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:09.253010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:09.254215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.266660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b173d-20b5-4027-b6ae-a689dab44e45 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:09.331056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:09.366026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:09.366418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:09.366725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:09.367023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:09.367735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:14:09.368073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:09.369184 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:09.369184 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:14:09.369184 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:14:09.370090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:09.381288 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 746/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:14:09.389696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:09.399573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f5cd-96e6-4746-8c53-ef344f4e570a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:09.461628 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:09.497025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:09.497635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:09.497909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:09.498179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:09.498880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:09.500580 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:09.500580 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:14:09.500580 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:14:09.501788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:09.556886 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 751/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:14:09 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:09.561162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:09.562711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.597472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420f83-30e3-450a-8d3c-7a69a86d95dc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:09.694278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:09.694278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:09.694278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:09.694278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:09.694775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:09.695710 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:09.695710 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:14:09.695710 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:14:09.696955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:09.739103 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 747/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:14:09 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:14:09.743964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:09.745479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.807016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717b672-7bd1-4700-8e16-101de3cbb9fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:09.889987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:09.902131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:09.902751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:09.903084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:09.903360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:09.904087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:09.905098 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:09.905098 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:14:09.905098 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:14:09.905983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:09.918332 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 752/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:09.922442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:09.924052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:09.940190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8dd8b-becf-4d72-af5a-8ee932a366bd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:09.968783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:10.040193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:10.040810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.041090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.041362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.042052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:10.043070 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:10.043070 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:14:10.043070 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:14:10.043981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743cf4-e6a2-42eb-ad69-4f04f6eb2dd7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:10.056314 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 748/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:14:10.060732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:10.062214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:10.096278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d478-0973-4420-a5fe-58d38ce9afc2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:10.191889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:10.192593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.192882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.193156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] PATH_INFO: `/v3/projects/d3231c877b3147508a23f15f4c376f78/users/266c0af034014342b4310ae48a06c138/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.216064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3231c877b3147508a23f15f4c376f78, user_id=266c0af034014342b4310ae48a06c138, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:10.217092 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:10.217092 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:14:10.217092 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:14:10.219026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92ee7b-a51d-4283-a950-b186d003f237 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:10.243990 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 753/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:14:10 2022] PUT /identity/v3/projects/d3231c877b3147508a23f15f4c376f78/users/266c0af034014342b4310ae48a06c138/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:10.256063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5291-f47d-4dca-9975-22e423bfd13b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.256439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5291-f47d-4dca-9975-22e423bfd13b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.256723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b5291-f47d-4dca-9975-22e423bfd13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.315442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7c8b5291-f47d-4dca-9975-22e423bfd13b None None] MFA Rules not processed for user `266c0af034014342b4310ae48a06c138`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:10.316628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7c8b5291-f47d-4dca-9975-22e423bfd13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:10.395345 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 749/1502] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:10.409103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.409392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.409671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.411056 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 754/1503] 10.222.0.47 () {54 vars in 964 bytes} [Sun Jul 31 01:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:14:10.416210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364707-59af-4abe-8d38-043fc5bd964b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.416505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364707-59af-4abe-8d38-043fc5bd964b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.416788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f364707-59af-4abe-8d38-043fc5bd964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.449224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:10.494925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8f364707-59af-4abe-8d38-043fc5bd964b None None] MFA Rules not processed for user `8d1d0d00aea849cb97808332cb98cfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:10.496169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8f364707-59af-4abe-8d38-043fc5bd964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:10.571679 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 750/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Sun Jul 31 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:10.579441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:10.581013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:10.630845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:10.684695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeb1c6-4a98-4d67-9912-5559209c8bed None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:10.759519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:10.760162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.760444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.760716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.762331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:10.858657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:10.860033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:10.863707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:10.880968 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 755/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:10.927130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113b21-a230-4a42-a7fc-a8c2c604eeb7 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:10.927595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113b21-a230-4a42-a7fc-a8c2c604eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:10.927789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113b21-a230-4a42-a7fc-a8c2c604eeb7 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:10.930189 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 751/1506] 10.222.0.47 () {52 vars in 830 bytes} [Sun Jul 31 01:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:14:10.933941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:10.935178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:11.035489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbba7f-82ed-47e4-8438-a89d1b38e98c service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:11.128990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:11.129625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:11.129829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:11.130109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] PATH_INFO: `/v3/users/266c0af034014342b4310ae48a06c138` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:11.142998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266c0af034014342b4310ae48a06c138)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:11.144057 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:11.144057 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:14:11.144057 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:14:11.145289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:11.155913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:11.212201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266c0af034014342b4310ae48a06c138'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:11.221885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266c0af034014342b4310ae48a06c138'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:11.222392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266c0af034014342b4310ae48a06c138'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:11.235644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266c0af034014342b4310ae48a06c138'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:11.258296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266c0af034014342b4310ae48a06c138'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:11.265611 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 756/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:14:10 2022] DELETE /identity/v3/users/266c0af034014342b4310ae48a06c138 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:11.270005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:11.270292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:11.270572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:11.327608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:14:11.328852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:11.403347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:11.416154 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 752/1508] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:14:11.427355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:11.428985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:11.529980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb061de-2add-4d77-b7aa-3b43e39b9d45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:11.585671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:11.605974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:11.606595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:11.606873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:11.607144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:11.608803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:11.714954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:11.716388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf12f47-c119-4686-93ed-055d8c1c6a1b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:11.734934 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 757/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:14:12.061987 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:14:12.063355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:14:12.075795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b6785-ee39-4cbb-addb-bb125e1deca8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:14:12.175696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:14:12.176365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:14:12.176646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:14:12.176919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] PATH_INFO: `/v3/projects/d3231c877b3147508a23f15f4c376f78` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:14:12.187466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3231c877b3147508a23f15f4c376f78)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:14:12.188520 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:14:12.188520 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:14:12.188520 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:14:12.189716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:14:12.253263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3231c877b3147508a23f15f4c376f78', 'request_id': 'req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:12.266701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3231c877b3147508a23f15f4c376f78', 'request_id': 'req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:12.273882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3231c877b3147508a23f15f4c376f78', 'request_id': 'req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:12.300870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] The token cache is being invalidate because project d3231c877b3147508a23f15f4c376f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:14:12.301189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:12.301618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7b3bb632-5ef2-4596-85c2-ebe98e10ece3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:14:12.303703 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 753/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:14:12 2022] DELETE /identity/v3/projects/d3231c877b3147508a23f15f4c376f78 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:14:21.732702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=62 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:14:22.298770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:00.424855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:00.425475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:00.425475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:00.426832 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:00.434098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec62a4-4390-447d-bc4b-711d40ef3ed5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:00.434565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec62a4-4390-447d-bc4b-711d40ef3ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:00.434674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec62a4-4390-447d-bc4b-711d40ef3ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:00.514685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a2ec62a4-4390-447d-bc4b-711d40ef3ed5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:00.515902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2ec62a4-4390-447d-bc4b-711d40ef3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:00.620781 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:00.783808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:00.785915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:00.904478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb102e-4a76-4a73-97c3-c7f1ddb9eefc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:00.910126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:00.910749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:00.911034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:00.911316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:00.920169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:00.921748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3b8c-a60f-412a-af01-8000630d7734 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:00.931715 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 759/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:01.757408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec31b1-05f5-4706-aaf6-fe7724fddd63 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:01.757942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec31b1-05f5-4706-aaf6-fe7724fddd63 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:01.757942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec31b1-05f5-4706-aaf6-fe7724fddd63 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:01.759272 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:01.764011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9041-a7fd-42d5-b022-61443bc26fcb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:01.764449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9041-a7fd-42d5-b022-61443bc26fcb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:01.764556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da9041-a7fd-42d5-b022-61443bc26fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:01.784750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-86da9041-a7fd-42d5-b022-61443bc26fcb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:01.785960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-86da9041-a7fd-42d5-b022-61443bc26fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:01.794658 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:01.945201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec31b1-05f5-4706-aaf6-fe7724fddd63 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:01.961222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec31b1-05f5-4706-aaf6-fe7724fddd63 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:01.966684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:01.967287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:01.967568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:01.967843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:01.976651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:01.978231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd5f33-7839-412f-9eac-c991589e25a3 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:01.987555 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 756/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:02.149142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13a0-08cc-4a46-a1e4-7a96c40fdbd6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:02.149435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13a0-08cc-4a46-a1e4-7a96c40fdbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:02.149719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f13a0-08cc-4a46-a1e4-7a96c40fdbd6 None None] PATH_INFO: `/v3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:02.151084 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 761/1517] 10.222.0.58 () {54 vars in 925 bytes} [Sun Jul 31 01:16:02 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:16:02.157876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ba26-d2bd-41b8-98f8-e59dcf4ae764 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:02.158197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ba26-d2bd-41b8-98f8-e59dcf4ae764 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:02.158471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1ba26-d2bd-41b8-98f8-e59dcf4ae764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:02.217625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-47c1ba26-d2bd-41b8-98f8-e59dcf4ae764 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:02.218819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-47c1ba26-d2bd-41b8-98f8-e59dcf4ae764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:02.234977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:02.290140 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 757/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Sun Jul 31 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:11.342217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704f749-9c5c-4a3a-9628-fca1991a6471 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:11.342735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704f749-9c5c-4a3a-9628-fca1991a6471 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:11.342735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704f749-9c5c-4a3a-9628-fca1991a6471 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:11.344106 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 762/1519] 10.222.0.47 () {54 vars in 961 bytes} [Sun Jul 31 01:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:11.349216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33012-9bd8-433e-bb4d-9c3d95560221 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:11.349674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33012-9bd8-433e-bb4d-9c3d95560221 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:11.349779 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33012-9bd8-433e-bb4d-9c3d95560221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:11.370734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-50c33012-9bd8-433e-bb4d-9c3d95560221 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:11.371946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-50c33012-9bd8-433e-bb4d-9c3d95560221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:11.380470 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 758/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Sun Jul 31 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:11.388573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704f749-9c5c-4a3a-9628-fca1991a6471 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:11.402868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704f749-9c5c-4a3a-9628-fca1991a6471 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:11.407860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:11.408488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:11.408773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:11.409051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:11.417622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:11.419192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d74-1da1-41fc-897f-12ce7b333a19 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:11.429803 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 763/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:16:13.226199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7da8-9b52-4a60-82fb-d9a7906da829 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.226765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7da8-9b52-4a60-82fb-d9a7906da829 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.226765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe7da8-9b52-4a60-82fb-d9a7906da829 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.228179 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:13.232938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df36ff-5061-4b6b-9e46-d7ed344da973 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.233354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df36ff-5061-4b6b-9e46-d7ed344da973 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.233523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df36ff-5061-4b6b-9e46-d7ed344da973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.252529 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3df36ff-5061-4b6b-9e46-d7ed344da973 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:13.253718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3df36ff-5061-4b6b-9e46-d7ed344da973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:13.261665 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:13.415916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7da8-9b52-4a60-82fb-d9a7906da829 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:13.430742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe7da8-9b52-4a60-82fb-d9a7906da829 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:13.436278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:13.436894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:13.437179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:13.437455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:13.446664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:13.448296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bf16a-5d6c-441f-9eba-47a59c0055a7 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:13.458119 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 760/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:14.280578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be320-011e-4041-aba9-34c59ad4cca4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.281177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be320-011e-4041-aba9-34c59ad4cca4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.281177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be320-011e-4041-aba9-34c59ad4cca4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.282399 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 31 01:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:14.287620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda142-db6f-47a9-b4f4-563add43df00 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.288094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda142-db6f-47a9-b4f4-563add43df00 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.288281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fda142-db6f-47a9-b4f4-563add43df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.307439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-58fda142-db6f-47a9-b4f4-563add43df00 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:14.308697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-58fda142-db6f-47a9-b4f4-563add43df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:14.316682 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 31 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:14.470816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be320-011e-4041-aba9-34c59ad4cca4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:14.485373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be320-011e-4041-aba9-34c59ad4cca4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:14.491327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:14.491966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:14.492253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:14.492528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:14.500586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:14.502159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9a624-1e16-4de1-84d7-ab41e54b499c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:14.512141 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 766/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:18.340722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:18.341374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:18.341374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:18.342718 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:18.347914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1009b6-2440-404c-bc0d-525bf2f4ca37 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:18.348375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1009b6-2440-404c-bc0d-525bf2f4ca37 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:18.348491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1009b6-2440-404c-bc0d-525bf2f4ca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:18.369736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9c1009b6-2440-404c-bc0d-525bf2f4ca37 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:18.370933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9c1009b6-2440-404c-bc0d-525bf2f4ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:18.378920 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:18.453215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:18.454915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:18.534708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd1fa5-1f4c-4782-b732-ee63e3049be5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:18.539167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:18.539818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:18.540180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:18.540460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:18.549387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:18.550826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b06c47-fd3e-4e80-8508-98219e1f4ebd service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:18.560782 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 763/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:20.602540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504838d4-9ae5-48b7-a52d-6e8ddda36a9d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:20.603092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504838d4-9ae5-48b7-a52d-6e8ddda36a9d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:20.603092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504838d4-9ae5-48b7-a52d-6e8ddda36a9d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:20.604498 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:20.609677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa41-f094-49a2-9aec-ebc4f4c79cec None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:20.610123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa41-f094-49a2-9aec-ebc4f4c79cec None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:20.610239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa41-f094-49a2-9aec-ebc4f4c79cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:20.629930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2af7fa41-f094-49a2-9aec-ebc4f4c79cec None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:20.631658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2af7fa41-f094-49a2-9aec-ebc4f4c79cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:20.639667 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:20.675281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504838d4-9ae5-48b7-a52d-6e8ddda36a9d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:20.686131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504838d4-9ae5-48b7-a52d-6e8ddda36a9d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:20.689646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:20.690253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:20.690534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:20.690809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:20.699776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:20.701180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d92b-998b-45d6-b1f7-4a824f2316ea service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:20.711300 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 769/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:24.276631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.277161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.277161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.278438 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:24.283505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35b24-fd0c-44ab-b17d-849cd91f731e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.283906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35b24-fd0c-44ab-b17d-849cd91f731e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.284099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf35b24-fd0c-44ab-b17d-849cd91f731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.292221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:24.304666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3bf35b24-fd0c-44ab-b17d-849cd91f731e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:24.305868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3bf35b24-fd0c-44ab-b17d-849cd91f731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:24.313672 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:24.620131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:24.621834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:24.686756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:24.701060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0568a9d-8d4a-452b-b9fc-a59fbd91abe8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:24.704759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:24.705375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:24.705660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:24.705937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:24.716521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:24.718016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206014e8-fb66-42b7-adb7-bc3f8e9d51b7 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:24.727950 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 766/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:26.766701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:26.767231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:26.767231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:26.768593 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 31 01:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:16:26.773967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39acaa-5bf3-448c-be9b-6dd35e242448 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:26.774402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39acaa-5bf3-448c-be9b-6dd35e242448 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:26.774510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39acaa-5bf3-448c-be9b-6dd35e242448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:26.794494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fe39acaa-5bf3-448c-be9b-6dd35e242448 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:16:26.795700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe39acaa-5bf3-448c-be9b-6dd35e242448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:26.804166 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 31 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:16:27.121527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:16:27.123209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:16:27.136461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0a83-617b-4859-bcbf-5281f5b30e33 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:16:27.140110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:16:27.140717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:16:27.140995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:16:27.141267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:16:27.150167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:16:27.151644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e60c9-a3b4-44ed-9df9-b48a03a9b55c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:16:27.161122 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 772/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:16:36.789763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=11 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:16:37.156834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:06.726991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.751314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.751314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.757270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:06.758531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:06.769657 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 768/1540] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:06.778798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.779395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.779395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.810338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:06.811595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:06.822369 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 773/1541] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:06.827732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:06.841542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455341b1-f7bc-4875-b2fb-ea67276f8744 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:06.848002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:06.848652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.848934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.849212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.849924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:06.850230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:06.854339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:06.870534 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 769/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:06.879520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:06.895097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e373492-4daa-4a9d-ad00-048a3083b820 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:06.902066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:06.902704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:06.902979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:06.903250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:06.903915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:06.905829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f145e1-25ec-42ce-8f68-1d08fc236d15 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:06.959942 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 774/1543] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:06 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:06.963749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:06.975280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9056-8523-4e79-9815-49e8e46b6854 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.043320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.070918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.070918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.071153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.071153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.071153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.071153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.071530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.071530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2b486-24e8-416b-9981-271dba7b3750 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.089364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.090651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.103676 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 770/1544] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:06 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.105247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365d9e-be39-4925-b88c-392843bd516b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.105539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365d9e-be39-4925-b88c-392843bd516b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.105819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365d9e-be39-4925-b88c-392843bd516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.116815 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 775/1545] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:07.117718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.138674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6508495-f917-4b1d-9e98-8e6fa3398d3f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.142589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-75365d9e-be39-4925-b88c-392843bd516b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.143867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75365d9e-be39-4925-b88c-392843bd516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.152437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.153081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.153376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.153654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.154365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.156135 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3ea90-8ced-4c60-a84f-dc6d26859b4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.157861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 771/1546] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.159158 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5eb2e-fbee-4c20-9fe2-179e06848f0a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.159448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5eb2e-fbee-4c20-9fe2-179e06848f0a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.159721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5eb2e-fbee-4c20-9fe2-179e06848f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.177711 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 776/1547] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:07.181748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.182040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.182319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.196591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7ae5eb2e-fbee-4c20-9fe2-179e06848f0a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.197785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7ae5eb2e-fbee-4c20-9fe2-179e06848f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.219156 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 772/1548] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.223739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.230360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.230360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.230602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.230602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.258750 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 777/1549] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.259634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.268093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.269411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.281219 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 773/1550] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.284698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032c81-432c-47f6-b02c-15df2c70eb7c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.286366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.302192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.302749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.303027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.303291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.304018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.304889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bfdfc-3287-4aec-961e-6a356f806e0a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.305708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fb2f9-70cf-4912-8e75-f2d9767a0a7c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.312383 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.313836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.314651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.315165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.316125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.316975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.317901 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 778/1551] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:07.319309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.319598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.319878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.320226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207092-f81a-4c9a-81bc-505a1683a17a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.336329 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 774/1552] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.338622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b267-cfaa-4267-9063-8a195dc401cf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.339154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b267-cfaa-4267-9063-8a195dc401cf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.339649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b267-cfaa-4267-9063-8a195dc401cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.341847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.343015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.352110 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 779/1553] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.353167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.363761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a446f97-a527-4bf1-baca-268679ca46fd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.365959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d732b267-cfaa-4267-9063-8a195dc401cf None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.367871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d732b267-cfaa-4267-9063-8a195dc401cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.368827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.369643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.369928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.370204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.371019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.371311 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.372379 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:07.372379 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:18:07.372379 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:18:07.373426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.381740 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 775/1554] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.383337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.383957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.384460 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.403131 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 780/1555] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.405437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.417633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.418777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8579-8962-403b-81a1-831af50e9ba5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.419095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.423631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.424337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.424616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.424892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] PATH_INFO: `/v3/projects/7f374e3e34684c6488d8578ed49600f7/users/d9d88c6d79444b269fb772cca5bae191/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.427914 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 776/1556] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.428707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.439752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c3855-6c37-4962-8fa5-2a16cc3a6717 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.443443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f374e3e34684c6488d8578ed49600f7, user_id=d9d88c6d79444b269fb772cca5bae191, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.444636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.445256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.445536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.445814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.446325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.446453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.447469 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:07.447469 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:18:07.447469 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:18:07.448694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab428a-ec77-4480-a973-f1c21de2db0e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.462407 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 781/1557] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:07 2022] PUT /identity/v3/projects/7f374e3e34684c6488d8578ed49600f7/users/d9d88c6d79444b269fb772cca5bae191/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:07.463526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.478294 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 777/1558] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.479432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12cec2-a27d-4aba-8797-b30a5179bc69 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.479727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12cec2-a27d-4aba-8797-b30a5179bc69 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.480043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12cec2-a27d-4aba-8797-b30a5179bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.498882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-da12cec2-a27d-4aba-8797-b30a5179bc69 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.500214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-da12cec2-a27d-4aba-8797-b30a5179bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.528884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc0b5dd-5dd4-4754-b719-76d34d368703 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.570113 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 778/1559] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.570113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b6c60-7821-4d4f-bb54-a5f74f786b83 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.570113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b6c60-7821-4d4f-bb54-a5f74f786b83 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.570113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b6c60-7821-4d4f-bb54-a5f74f786b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.572492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:07.581384 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:07.586257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dc7b6c60-7821-4d4f-bb54-a5f74f786b83 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.587501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dc7b6c60-7821-4d4f-bb54-a5f74f786b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.592432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.593063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.593349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.593630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.594381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.594699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.595797 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 779/1560] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.596396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.597102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76123-ebc0-4312-bdb4-6022af796355 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.597380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76123-ebc0-4312-bdb4-6022af796355 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.597667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76123-ebc0-4312-bdb4-6022af796355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.609244 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 782/1561] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.610063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.617482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e4b76123-ebc0-4312-bdb4-6022af796355 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.618667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e4b76123-ebc0-4312-bdb4-6022af796355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.626389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca929ef8-ea9e-4949-a92a-a6bb2c243529 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.627307 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 780/1562] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.627307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1096f8-27ec-4d85-a067-dedc09d1e03b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.627307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1096f8-27ec-4d85-a067-dedc09d1e03b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.627307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1096f8-27ec-4d85-a067-dedc09d1e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.634208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.634738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.635019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.635293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.635976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.637865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.649002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bc1096f8-27ec-4d85-a067-dedc09d1e03b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.650194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bc1096f8-27ec-4d85-a067-dedc09d1e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.658464 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 781/1563] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.659729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938200-5493-4227-8423-344d5100395c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.660042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938200-5493-4227-8423-344d5100395c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.660314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938200-5493-4227-8423-344d5100395c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.669954 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 783/1564] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.669954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.692004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-05938200-5493-4227-8423-344d5100395c None None] MFA Rules not processed for user `d9d88c6d79444b269fb772cca5bae191`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.693253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-05938200-5493-4227-8423-344d5100395c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.729848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c43565-9b37-4f83-9d8e-9ec57ee33a6c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.734554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.735337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.735739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.735916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.736573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.737580 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:07.737580 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:18:07.737580 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:18:07.738781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.758730 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 782/1565] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.762732 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 784/1566] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.762868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.762868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.762868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.763170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.773214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b364-fba7-4415-861d-69be265a3cf5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.777958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.778559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.778837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.779426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.779817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.780159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.780521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.781720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.781826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa232727-12e8-4f32-81b7-abcce2d41c44 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.790479 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 783/1567] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.791240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.795853 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 785/1568] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.797302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.798110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.798413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.807466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbb0a6-0498-4fe2-8993-42ec12e4cb62 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.812219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.812832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.813199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.814009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.814680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.816630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.818220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:07.819438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:07.827605 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 786/1569] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:07.828344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.841653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e1e00-a8f7-4cf0-80fd-133b2d160773 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.845626 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 784/1570] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.846371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.846580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.846986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.847286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.847545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.848285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:07.848592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.850274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.869607 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 787/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:07.869607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.873460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d453f-c07e-41fc-b862-7ff5ab78b873 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.908684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04547bb1-43c5-4fe8-bea5-30cb91044a23 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.913404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.914024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.914322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.914636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.915300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.917260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.930818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.931478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.931805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.932127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.932831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.934809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.939158 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 785/1572] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.940308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.950256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ec83-d875-411b-bd25-d6c67870fd56 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:07.956432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:07.957098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:07.957932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:07.958212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:07.958985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:07.960661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:07.964498 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 788/1573] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:07.965375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.970993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:07.972106 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 786/1574] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:07.972906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:07.984861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918fbb6-f21a-4f39-a740-7941cd646614 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.007336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.037194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185a293-17ba-43db-98db-a738d0e78c3e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.042224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.042913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.043252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.043531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.044286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:08.044616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.046235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.053017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.053691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.054005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.054285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.054947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.056964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.058005 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 789/1575] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:08.058814 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.069756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86135d-1e94-4c8f-bdd9-5c4929897de5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.074320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.074936 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.075217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.075493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.076213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:08.076550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.078186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.094790 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 787/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:07 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.095013 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 790/1577] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:08.095118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.095226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.102372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81773a-76b4-4ca1-a7b3-6d86629aec40 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.160506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.161127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.161413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.161838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.162504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.163047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be8ef6-bf8f-46fc-a91b-4bcf2115b857 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.164471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.168730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.169349 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.169629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.169911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.170572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.172560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.196909 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 791/1578] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.197134 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 788/1579] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.197134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.197330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.206690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6474-4988-4704-843f-ef1c6e111126 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.264346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.265441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.265441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.265661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.266173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.268900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.280837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ce05-bda0-4575-a0c4-510e32758451 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.287374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.288058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.288369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.288655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.289409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.291045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.291167 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 789/1580] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.292798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.303420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7da1c-0f6b-4977-b530-ff2d81a7f342 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.307106 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 792/1581] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.307106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.310894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.311503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.311805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.312105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.312804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.315089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.317186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b92104-926a-4531-9829-30a78b1b70a0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.321877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.322491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.322781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.323064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.323918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.325842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.326044 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 790/1582] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.326825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.330718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.337167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfacc4-2693-4878-bddc-1e7d16576cc7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.342482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.343210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.343504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.343787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.345032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.346962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.356976 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 793/1583] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.357788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.367317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.373446 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 791/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.374655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.386593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99657-dc40-48ee-8248-092bb5203764 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.425089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb362-e9cb-4a77-9ba5-0a399b4f0732 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.430040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.430751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.431104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.431464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.432153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.434063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.449350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.450147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.450563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.450902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.451568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.453588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.464596 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 794/1585] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.465879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.480408 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 792/1586] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.481506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.492282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3e11c-4084-4e5e-a989-a1ebedbd37ec admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.531587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2dff2-fa0b-454c-80e2-74b1e4710c8d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.537143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.537845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.538130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.538401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.539093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.540833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.551007 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 795/1587] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.551800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.555247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.555876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.556200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.556483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.557209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.558821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.561191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f62bc-ba47-4a71-8900-d7dbe0b30b58 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.566331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.566951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.567235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.567511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.568223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.572757 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 793/1588] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.572909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.573012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.581731 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 796/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.582449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.583548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf140cf-b08e-4794-9e53-3fbe81c52f1b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.588335 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.589129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.589526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.590189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] PATH_INFO: `/v3/projects/fb8ce651340a4fd7b2e42e2728e85aa1/users/9857d08d4d7a46e3a377e2d60673ab80/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.593895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7223dd-9016-4687-8e25-c3d8202ebf39 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.599279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.599887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.600212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.600491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.601184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.603092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.605783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8ce651340a4fd7b2e42e2728e85aa1, user_id=9857d08d4d7a46e3a377e2d60673ab80, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.606806 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:08.606806 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:18:08.606806 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:18:08.608825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.623263 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 794/1590] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:08 2022] PUT /identity/v3/projects/fb8ce651340a4fd7b2e42e2728e85aa1/users/9857d08d4d7a46e3a377e2d60673ab80/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:08.627402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.627585 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 797/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.628827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.638837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930478fc-2c27-4432-b97c-6454a632c7a4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.675716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.692501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3324c5-bcba-41fa-b4b9-ca7d2c92b39b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.697152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.697771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.698056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.698359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.699034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.700684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.701117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.701811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.702036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.702317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.702442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:08.703007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.706186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.714281 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 795/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.717497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.725855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deba806-ddaa-4f43-b397-63a096621a27 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.730788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.731410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.731692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.731975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.732689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.737157 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 798/1593] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:08.737157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.737382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.745182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb85a9-c921-472c-92e6-31168a0a83fe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.745726 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 796/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.746502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.753845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.754479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.754765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.755044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.755746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.756803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebabf2-cadf-41d2-8451-c3d22e93c7d4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.757388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.761385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.762026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.762313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.762591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] PATH_INFO: `/v3/projects/6b66cafc8338464ea442d12e512749fe/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.768584 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 799/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.769380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.778363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b66cafc8338464ea442d12e512749fe, user_id=e4d8c4e7c38f4d389c7b7f5fd5e1163c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.778874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f860e-caee-4446-8e7c-bd68e364f2fa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.781064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888b0a9-07c2-4e71-8dc0-05ed9aafd1b7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.784482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.785153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.785441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.785719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] PATH_INFO: `/v3/projects/e4376b49b44144a39f4af03fc462b61b/users/a91d548b76124ecaa338f5fccfd043bc/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.794211 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 797/1596] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:08 2022] PUT /identity/v3/projects/6b66cafc8338464ea442d12e512749fe/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:08.795528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.795817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.796147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.802723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4376b49b44144a39f4af03fc462b61b, user_id=a91d548b76124ecaa338f5fccfd043bc, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.805454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.815105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:08.816340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:08.818716 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 800/1597] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:08 2022] PUT /identity/v3/projects/e4376b49b44144a39f4af03fc462b61b/users/a91d548b76124ecaa338f5fccfd043bc/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:08.822386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.879502 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 798/1598] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:08.882553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.882785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35db828-2102-4430-9cfa-7f0dd1475c41 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.888407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.889810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.890103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.890384 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.891115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.892676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf7baf-f994-4803-8db6-248679c8eb54 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.893323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.897406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.898034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.898320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.898598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.899292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.900908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.903581 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 801/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.904353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.912508 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 799/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.913348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.915354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5012d-00aa-4ad4-a851-2338c9bfba5c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.920027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.920638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.920920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.921205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.921920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.922774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3893-6acf-417c-87ba-d324dd73a5af admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.924023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.927594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.928269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.928560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.928834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.929520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.931080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.937177 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 802/1601] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.937177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.945776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782594-8f9a-4618-845d-65e36dac3eb5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.947541 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 800/1602] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.948423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:08.950633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.951288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.951574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.951856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] PATH_INFO: `/v3/projects/e4bee49d1a674f60b62a4dd0c80c1866/users/bd896e56eee346018faf5c4e09f47c1d/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.958831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2de3b-0784-43f8-acc0-e6301efcd99b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:08.963406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:08.964039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.964326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.964599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.965277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.966848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1facb7-8b31-47eb-83b6-69c4cab6ae04 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.968068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bee49d1a674f60b62a4dd0c80c1866, user_id=bd896e56eee346018faf5c4e09f47c1d, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:08.971803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:08.979287 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 801/1603] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:08.981370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:08.981664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:08.981944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:08.986701 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 803/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:08 2022] PUT /identity/v3/projects/e4bee49d1a674f60b62a4dd0c80c1866/users/bd896e56eee346018faf5c4e09f47c1d/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:08.988905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.003472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.005010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.046545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f4755-eed6-45a4-a3f0-3b9bb3d75e35 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.050831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.051444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.051767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.052035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.057254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:09.069263 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 802/1605] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.070124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.084959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f2697-5e25-4c25-b204-ca24bf5db2df None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.089829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.090442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.090719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.090989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.091672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.093330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.104545 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 803/1606] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:09.105249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.115190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22324475-d3e6-49dc-a9dc-a51db0e7205a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.119224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.120206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.120685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.120856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.121141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.121418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] PATH_INFO: `/v3/projects/0a140f9b83f44aefbfe55928b6dab5da/users/4d5e6e88e3bd4535bfb540e8dc1d98f1/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.130793 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 804/1607] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:09.131672 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.138219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a140f9b83f44aefbfe55928b6dab5da, user_id=4d5e6e88e3bd4535bfb540e8dc1d98f1, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.140683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d4e4e-9abc-44cf-8a51-b6374ca00843 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.142076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.145007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:09.148802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.149429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.149713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.150003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.150694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.152574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.159904 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 804/1608] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:09 2022] PUT /identity/v3/projects/0a140f9b83f44aefbfe55928b6dab5da/users/4d5e6e88e3bd4535bfb540e8dc1d98f1/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:09.160834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.168929 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 805/1609] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:09.170175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.183473 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0dc102-22a0-4e8f-8a66-341419c86c75 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.237803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f819-6278-4b84-9046-a39a07eaedd2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.243218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.244117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.244406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.244828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] PATH_INFO: `/v3/projects/1ec743715c294e29b3ea4c8f9be02a50/users/85cc19b4fb6c49618b154669ec858b44/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.256315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.256990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.257385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.257541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] PATH_INFO: `/v3/projects/6b66cafc8338464ea442d12e512749fe/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.260374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b66cafc8338464ea442d12e512749fe, user_id=e4d8c4e7c38f4d389c7b7f5fd5e1163c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.262240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec743715c294e29b3ea4c8f9be02a50, user_id=85cc19b4fb6c49618b154669ec858b44, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.263619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f122a-f9aa-473b-a330-f4f258d85a5e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.265029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.278196 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 806/1610] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:09 2022] PUT /identity/v3/projects/6b66cafc8338464ea442d12e512749fe/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:09.279589 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 805/1611] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:09 2022] PUT /identity/v3/projects/1ec743715c294e29b3ea4c8f9be02a50/users/85cc19b4fb6c49618b154669ec858b44/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:09.291499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.291841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.291841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.291841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.293584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.318638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.320518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.388507 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63e8-77d0-43ac-9042-7fc9f0be604b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.392468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.393095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.393377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.393656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.411794 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 807/1612] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.411794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.424780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f0b9e-8dfe-4c48-a99d-ffd44b0e70ee None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.435476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.436196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.436484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.436769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] PATH_INFO: `/v3/projects/19bd23a653cf4c368a47163fda224d8d/users/e117c5cc43a34179b69ac8ba1529b3a8/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.458030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bd23a653cf4c368a47163fda224d8d, user_id=e117c5cc43a34179b69ac8ba1529b3a8, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.460700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321fbce-d17b-45ec-9a4f-68b2c102729c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.472837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.475786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.478797 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 808/1613] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:09 2022] PUT /identity/v3/projects/19bd23a653cf4c368a47163fda224d8d/users/e117c5cc43a34179b69ac8ba1529b3a8/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:09.481482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaa4a-e1d5-42ad-b0bf-e26bde26ddc4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.481776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaa4a-e1d5-42ad-b0bf-e26bde26ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.482059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbaa4a-e1d5-42ad-b0bf-e26bde26ddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.490705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:09.495812 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 806/1614] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:09.496856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.515311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265665-2fe6-47d1-a659-ed848d7b69f1 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.522008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3dcbaa4a-e1d5-42ad-b0bf-e26bde26ddc4 None None] MFA Rules not processed for user `4d5e6e88e3bd4535bfb540e8dc1d98f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.523417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3dcbaa4a-e1d5-42ad-b0bf-e26bde26ddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.550944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:09.611149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.612176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.614624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.614932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] PATH_INFO: `/v3/projects/32727758328a42ba9e16bae3415066c8/users/6769f68c29f240d6b8f95440179879b8/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.633885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32727758328a42ba9e16bae3415066c8, user_id=6769f68c29f240d6b8f95440179879b8, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.638292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875ba7-4cf7-4c6f-ae12-557cd565aef3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.640331 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 809/1615] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.642842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.643239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.643522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.659153 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 807/1616] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:09 2022] PUT /identity/v3/projects/32727758328a42ba9e16bae3415066c8/users/6769f68c29f240d6b8f95440179879b8/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:09.660686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b59c6-10d7-4a27-ad35-dd3b1016b978 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.661456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b59c6-10d7-4a27-ad35-dd3b1016b978 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.661917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b59c6-10d7-4a27-ad35-dd3b1016b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.679541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] MFA Rules not processed for user `85cc19b4fb6c49618b154669ec858b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.681100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.697875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-384b59c6-10d7-4a27-ad35-dd3b1016b978 None None] MFA Rules not processed for user `e4d8c4e7c38f4d389c7b7f5fd5e1163c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.699213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-384b59c6-10d7-4a27-ad35-dd3b1016b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.763772 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 810/1617] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.763772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.790290 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 808/1618] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.791660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.791977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.792268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.822785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:09.824551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:09.842479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a89e-e996-4727-a203-6dcd4c20b569 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.847353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.848371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.848507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.848890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.899197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:09.935000 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 809/1619] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:09.936372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:09.953415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1408-c80b-4d34-80d2-d9041a17d85a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:09.955644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.958191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee09e1-1da2-427c-a6e5-7427e2b1adac service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.961507 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:09.962533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.962819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.963273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:09.963993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:09.966187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:09.979333 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 811/1620] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:09.984703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243d13-ce18-4ac1-b11c-40f491de5cba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:09.984703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243d13-ce18-4ac1-b11c-40f491de5cba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:09.987249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243d13-ce18-4ac1-b11c-40f491de5cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.007125 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 810/1621] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:10.008916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.034687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:10.049456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d6243d13-ce18-4ac1-b11c-40f491de5cba None None] MFA Rules not processed for user `6769f68c29f240d6b8f95440179879b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:10.053932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d6243d13-ce18-4ac1-b11c-40f491de5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:10.091447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627aed4-8d99-415f-8fdb-1dddd31c3d30 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.097296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443378-4158-4966-865b-27f847047904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.098225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443378-4158-4966-865b-27f847047904 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.098671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443378-4158-4966-865b-27f847047904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.099197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1443378-4158-4966-865b-27f847047904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.194852 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 812/1622] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:10.197715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24574d-3e0a-4b0c-adbd-a08349c7fb82 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.198033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24574d-3e0a-4b0c-adbd-a08349c7fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.199819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24574d-3e0a-4b0c-adbd-a08349c7fb82 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.204703 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 813/1623] 10.222.0.47 () {54 vars in 962 bytes} [Sun Jul 31 01:18:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:10.205590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24574d-3e0a-4b0c-adbd-a08349c7fb82 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.227235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443378-4158-4966-865b-27f847047904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.228739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1443378-4158-4966-865b-27f847047904 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.257035 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 811/1624] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:10.257982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443378-4158-4966-865b-27f847047904 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.352849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24574d-3e0a-4b0c-adbd-a08349c7fb82 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.362501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.364432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.364758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.365029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.399050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1443378-4158-4966-865b-27f847047904 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.409729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.410570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.410862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.411327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.411810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.418037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.468927 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 812/1625] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:10 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:10.470879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.491382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f558b1-75fd-45cd-9c87-1a1b4d3c8798 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.505622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.505622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.505622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.506088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.506438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.508423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.531921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.533504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdaab43-4a6b-49c6-b250-1d3be2a117c0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.560299 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 814/1626] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:10.565218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.576378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.576743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.612014 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 813/1627] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:10 2022] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:10.612823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.625398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:10.680907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:10.683343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:10.700938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:10.771126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a69031-b57b-47e3-82ea-1178edf485ae admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.776385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.777093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.777570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.777814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.779006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.781033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.796636 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 814/1628] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:10.798527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.815584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4746-76e9-4f00-be47-b8e26292f5f2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.823816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.824526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.824992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.825325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.826860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.830982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:10.868818 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 815/1629] 10.222.0.47 () {58 vars in 1059 bytes} [Sun Jul 31 01:18:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:10.872819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.899594 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 815/1630] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:10 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:10.900613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:10.914393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e1037-8124-465d-8520-c57d32dab8f1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.933174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.933944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.936253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.936539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] PATH_INFO: `/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874/users/df0389dbba864d2bbcff5284c27fe8cb/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.939254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73475a3f-8f38-4233-a01f-20f8731072ed admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:10.958805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:10.959845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:10.961550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:10.962177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:10.982671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e612b91cc2d8447d8ef8fab59d4cc874, user_id=df0389dbba864d2bbcff5284c27fe8cb, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:10.999214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.038327 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 816/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:10 2022] PUT /identity/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874/users/df0389dbba864d2bbcff5284c27fe8cb/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:11.039316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.175689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.179508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.207995 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 816/1632] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:11.212223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8cef8-e8e8-429d-970d-0ab3c6632f42 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.215980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.218310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.218950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.219737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.220060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.227741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.229520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.255901 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 817/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:11.257859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef04209-befa-492b-bf2b-9dfde4242c8b service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.265047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.285261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.294693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.296103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.296410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.298736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.302597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.308222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac47ebd-9c3c-42f6-822d-f6ce7a3f0ca9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.327620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.328423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.329302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.329584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] PATH_INFO: `/v3/projects/fbf88444701d477f8821f9ae753d30fe/users/2308fc0bffdc4316af5e1b8aedc49784/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.331897 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 817/1634] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:11.334912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.436255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0a746-7335-436e-bc34-f025cab4ece0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.436255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.436255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.436255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.464829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] PATH_INFO: `/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874/users/df0389dbba864d2bbcff5284c27fe8cb/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.464829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e612b91cc2d8447d8ef8fab59d4cc874, user_id=df0389dbba864d2bbcff5284c27fe8cb, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.465656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf88444701d477f8821f9ae753d30fe, user_id=2308fc0bffdc4316af5e1b8aedc49784, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.468780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67e30-e7a6-4845-9939-8be8cf76161c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.468984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.469174 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 818/1635] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:11 2022] PUT /identity/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874/users/df0389dbba864d2bbcff5284c27fe8cb/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:11.478085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.478767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.479058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.507678 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 818/1636] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:11 2022] PUT /identity/v3/projects/fbf88444701d477f8821f9ae753d30fe/users/2308fc0bffdc4316af5e1b8aedc49784/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:11.509516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.549116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] MFA Rules not processed for user `df0389dbba864d2bbcff5284c27fe8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:11.550667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:11.596587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:11.646615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c35d9-4808-4bab-9e79-b5dcdb5050b3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.656445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.657366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.658003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.658392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.659521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.668809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.689510 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 819/1637] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:11.691406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.724624 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 819/1638] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:11.724765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a370ce-6e1b-4de8-95d4-26e8fc2cf67e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.738324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:11.751849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.752595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.752884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.755180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:11.756570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] PATH_INFO: `/v3/projects/fbf88444701d477f8821f9ae753d30fe/users/2308fc0bffdc4316af5e1b8aedc49784/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.764563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf88444701d477f8821f9ae753d30fe, user_id=2308fc0bffdc4316af5e1b8aedc49784, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:11.773070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b6691-6364-4bdc-8e7c-df613efcded4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:11.802399 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 820/1639] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:11 2022] PUT /identity/v3/projects/fbf88444701d477f8821f9ae753d30fe/users/2308fc0bffdc4316af5e1b8aedc49784/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:11.815380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.815776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.815969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:11.849128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bdae0-8634-45a3-82a1-9507d9f0876f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:11.893703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] MFA Rules not processed for user `2308fc0bffdc4316af5e1b8aedc49784`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:11.895097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:11.972297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:11.973066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:11.973418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:11.975197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.126943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:12.127416 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 821/1640] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:12.129875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:12.150196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:12.167631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c35c-11e4-47c4-acb1-229622cf4f2d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:12.175994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:12.176938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:12.177383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:12.177665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.179077 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 820/1641] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:12.196566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:12.199112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3067c2c-814c-4c0e-86cc-df58f3bd360c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:12.214203 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 822/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:12.380576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:12.416229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ead26-3a33-4ce8-bc08-4611699e72b8 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:12.440567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:12.441219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:12.441631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:12.441817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.510935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:12.511279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:12.511493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.604550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] MFA Rules not processed for user `a91d548b76124ecaa338f5fccfd043bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:12.605808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:12.693488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:12.694972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbfe8b-1c80-49f6-9d0c-8de6aabfd8b5 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:12.720751 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 821/1643] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:12.725533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374bd9-21ac-473e-b916-222f0f930b74 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:12.725533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374bd9-21ac-473e-b916-222f0f930b74 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:12.725782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374bd9-21ac-473e-b916-222f0f930b74 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.730381 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 822/1644] 10.222.0.47 () {54 vars in 962 bytes} [Sun Jul 31 01:18:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:12.741360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:12.741609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:12.742003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:12.809894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:12.814367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:12.817064 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 823/1645] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:12.822198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:12.842360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:12.889806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:13.000197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bf209-5fdc-456a-a2f9-0efb27fb94cf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.015264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.016678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.017632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.018031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] PATH_INFO: `/v3/users/6769f68c29f240d6b8f95440179879b8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.021398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6769f68c29f240d6b8f95440179879b8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.023833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.044285 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 823/1646] 10.222.0.47 () {58 vars in 1059 bytes} [Sun Jul 31 01:18:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:13.046013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.070618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e33b7-0d7d-494d-9e81-9e35ee2acb86 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.089691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.090587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.090957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.091330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.093487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.100579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf210d6e-aab6-40cc-85ac-17ce05e8e7e4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.144125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6769f68c29f240d6b8f95440179879b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:13.160374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6769f68c29f240d6b8f95440179879b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:13.162177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6769f68c29f240d6b8f95440179879b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:13.169777 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 824/1647] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:13 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:13.175637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fae5f-92ce-457b-8e55-a1be8dc2aa6b None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.175791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fae5f-92ce-457b-8e55-a1be8dc2aa6b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.176110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fae5f-92ce-457b-8e55-a1be8dc2aa6b None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.178063 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 825/1648] 10.222.0.47 () {54 vars in 912 bytes} [Sun Jul 31 01:18:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:13.179149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fae5f-92ce-457b-8e55-a1be8dc2aa6b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.186032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6769f68c29f240d6b8f95440179879b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:13.217603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d6ed747f-5914-418a-8ded-23b10373a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6769f68c29f240d6b8f95440179879b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:13.231894 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 824/1649] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:12 2022] DELETE /identity/v3/users/6769f68c29f240d6b8f95440179879b8 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:13.234079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb765-be2a-4276-b0e7-01ce76c6dbc9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.234577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb765-be2a-4276-b0e7-01ce76c6dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.235024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fb765-be2a-4276-b0e7-01ce76c6dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.292992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-829fb765-be2a-4276-b0e7-01ce76c6dbc9 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:13.297293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-829fb765-be2a-4276-b0e7-01ce76c6dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:13.411136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fae5f-92ce-457b-8e55-a1be8dc2aa6b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.547669 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 825/1650] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:13.553616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.553616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.555288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.566745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.567812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.568526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.570121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.571380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.574825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.612558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:13.615078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:13.626565 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 826/1651] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:13 2022] POST /identity/v3/users => generated 309 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:13.631660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.634988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:13.638552 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 826/1652] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:13.667886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.669524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:13.669983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc5ee0-8c53-4fea-bb06-032bc648bfa2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.676361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.677211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.677675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.678108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.679222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.682132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.695175 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 827/1653] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:13.696353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.698269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:13.714479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:13.757012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:13.780567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986845c-e39a-460f-a267-9ec340fb0259 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.785154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.785984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.786401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.786806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.798560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.800385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.812172 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 828/1654] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:13.813400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.821025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d29058-abfd-4c65-9de2-92f6ff34d5d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.824960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438f39-4db7-420a-8121-6b803f1ed158 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:13.829510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.832729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.833025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.833309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.836776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:13.838017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:13.838575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:13.839196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] PATH_INFO: `/v3/projects/c69eaa27f35e4b009de9d70b38c5f600/users/6c25edc908fd43c8b6c77f32d5039089/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:13.860283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69eaa27f35e4b009de9d70b38c5f600, user_id=6c25edc908fd43c8b6c77f32d5039089, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.866314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.875380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:13.877371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:13.894833 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 829/1655] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:13 2022] PUT /identity/v3/projects/c69eaa27f35e4b009de9d70b38c5f600/users/6c25edc908fd43c8b6c77f32d5039089/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:13.899537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:13.904351 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 827/1656] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:14.081218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a903d-ab57-4aa2-8b86-57d50491dc04 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.088602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.089343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.089707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.090054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.090873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.093110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad31a1-edc8-4f34-bff1-883ec3ffa2c2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.114262 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 830/1657] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:14.115729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.130961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755176-b89f-4e27-ac2b-398809c50593 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.147645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.148404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.148732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.149390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] PATH_INFO: `/v3/projects/c69eaa27f35e4b009de9d70b38c5f600/users/6c25edc908fd43c8b6c77f32d5039089/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.153851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69eaa27f35e4b009de9d70b38c5f600, user_id=6c25edc908fd43c8b6c77f32d5039089, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.156610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.174462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bfac-dbd8-4c75-979a-5c70b1807bb9 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.174854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bfac-dbd8-4c75-979a-5c70b1807bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.175164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bfac-dbd8-4c75-979a-5c70b1807bb9 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.177990 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 831/1658] 10.222.0.47 () {54 vars in 912 bytes} [Sun Jul 31 01:18:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:14.186049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.186426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.186733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.189091 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 828/1659] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:14 2022] PUT /identity/v3/projects/c69eaa27f35e4b009de9d70b38c5f600/users/6c25edc908fd43c8b6c77f32d5039089/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:14.218791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.220640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.232065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:14.233459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.308472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0fc3-c41c-47a2-88a7-c0004404d6ff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.314421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.315252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.315540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.315817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] PATH_INFO: `/v3/users/d9d88c6d79444b269fb772cca5bae191` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.318919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d88c6d79444b269fb772cca5bae191)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.321377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.408354 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 832/1660] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:14.421660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.424269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.457321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d88c6d79444b269fb772cca5bae191'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:14.472165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:14.473687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d88c6d79444b269fb772cca5bae191'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:14.475833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d88c6d79444b269fb772cca5bae191'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:14.495772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d88c6d79444b269fb772cca5bae191'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:14.546411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a95a6543-78ee-4fc6-a942-d99694f3dddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d88c6d79444b269fb772cca5bae191'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:14.561126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fdbf6-747f-4967-a30a-92e17cb205d6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.565594 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 829/1661] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:14 2022] DELETE /identity/v3/users/d9d88c6d79444b269fb772cca5bae191 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:14.571771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.572157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.572443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.654008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:14.657217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.671300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.672263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.672721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.673160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.677722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.760990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:14.872288 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 830/1662] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:14.876602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.882910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.883081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.890600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:14.942153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085ffa5-e216-47a3-b35c-914e5cbc89d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:14.950263 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 833/1663] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:14.955148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:14.960458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:14.963573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:14.965557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:14.965850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:14.966127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] PATH_INFO: `/v3/projects/32727758328a42ba9e16bae3415066c8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:14.974190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32727758328a42ba9e16bae3415066c8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:14.976783 dv-cinder-master-3-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:14.976783 dv-cinder-master-3-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 31 01:18:14.976783 dv-cinder-master-3-smb devstack@keystone.service[80452]: Jul 31 01:18:14.981077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.219789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e3201-68e5-4d0d-80b6-7eecb9877a50 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:15.223508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32727758328a42ba9e16bae3415066c8', 'request_id': 'req-a5b5e807-3069-4d49-926d-33c18a62f5f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.248526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32727758328a42ba9e16bae3415066c8', 'request_id': 'req-a5b5e807-3069-4d49-926d-33c18a62f5f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.271253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32727758328a42ba9e16bae3415066c8', 'request_id': 'req-a5b5e807-3069-4d49-926d-33c18a62f5f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.311289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:15.319593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] The token cache is being invalidate because project 32727758328a42ba9e16bae3415066c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:15.319901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.321016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.330475 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 831/1664] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:14 2022] DELETE /identity/v3/projects/32727758328a42ba9e16bae3415066c8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:15.332047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:15.333691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:15.352316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:15.353060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.353455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.353835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.356417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:15.463413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e807-3069-4d49-926d-33c18a62f5f1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:15.472571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:15.473849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.476696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.477370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] PATH_INFO: `/v3/users/85cc19b4fb6c49618b154669ec858b44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.480433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cc19b4fb6c49618b154669ec858b44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:15.482946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.496136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:15.497818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.514894 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 834/1665] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:15.515784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:15.519019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:15.549955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3448c-8932-4270-9ce7-9456a3f98038 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:15.566958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:15.569066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.570582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.571163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] PATH_INFO: `/v3/users/2308fc0bffdc4316af5e1b8aedc49784` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.581500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2308fc0bffdc4316af5e1b8aedc49784)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:15.584561 dv-cinder-master-3-smb devstack@keystone.service[80453]: WARNING py.warnings [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 31 01:18:15.584561 dv-cinder-master-3-smb devstack@keystone.service[80453]: warnings.warn(msg) Jul 31 01:18:15.584561 dv-cinder-master-3-smb devstack@keystone.service[80453]: Jul 31 01:18:15.588428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:15.603298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cc19b4fb6c49618b154669ec858b44'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.620083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cc19b4fb6c49618b154669ec858b44'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.623104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cc19b4fb6c49618b154669ec858b44'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.637712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:15.644553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cc19b4fb6c49618b154669ec858b44'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.667068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e80f4dfc-00ec-46b3-992d-62ef927e08ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cc19b4fb6c49618b154669ec858b44'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.676115 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 832/1666] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:15 2022] DELETE /identity/v3/users/85cc19b4fb6c49618b154669ec858b44 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:15.680822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:15.681218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:15.681603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:15.731686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2308fc0bffdc4316af5e1b8aedc49784'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.734251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:15.737860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:15.756941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2308fc0bffdc4316af5e1b8aedc49784'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.757798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2308fc0bffdc4316af5e1b8aedc49784'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.758765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2308fc0bffdc4316af5e1b8aedc49784'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.787861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2308fc0bffdc4316af5e1b8aedc49784'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:15.809244 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 835/1667] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:15 2022] DELETE /identity/v3/users/2308fc0bffdc4316af5e1b8aedc49784 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:15.869681 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 833/1668] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:15.950870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:15.952649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:16.104347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4159fa-4c24-441e-a71b-8dbec2a55d3f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:16.111066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:16.111718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:16.112031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:16.112310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:16.117240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:16.224849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:16.227490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:16.251977 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 836/1669] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:17.316683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:17.318151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:17.350744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0fe66-46a3-461b-9637-e44afd29351a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:17.359968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:17.365355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.365651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.366066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] PATH_INFO: `/v3/projects/7f374e3e34684c6488d8578ed49600f7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.368305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f374e3e34684c6488d8578ed49600f7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:17.369921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:17.484874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f374e3e34684c6488d8578ed49600f7', 'request_id': 'req-2737ae7b-eb77-4dd0-a450-99e885be1c37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.494757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f374e3e34684c6488d8578ed49600f7', 'request_id': 'req-2737ae7b-eb77-4dd0-a450-99e885be1c37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.507650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f374e3e34684c6488d8578ed49600f7', 'request_id': 'req-2737ae7b-eb77-4dd0-a450-99e885be1c37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.531874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] The token cache is being invalidate because project 7f374e3e34684c6488d8578ed49600f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:17.532541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.534032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.539035 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 834/1670] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:17 2022] DELETE /identity/v3/projects/7f374e3e34684c6488d8578ed49600f7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:17.540008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:17.561395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1351e2-60f0-4a08-9805-f6127d968a55 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:17.733895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:17.735094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.735461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.736016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] PATH_INFO: `/v3/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.741253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d8c4e7c38f4d389c7b7f5fd5e1163c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:17.743238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:17.796069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:17.798336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:17.831689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ae7b-eb77-4dd0-a450-99e885be1c37 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:17.846899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:17.849781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:17.850097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:17.851648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] PATH_INFO: `/v3/projects/1ec743715c294e29b3ea4c8f9be02a50` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:17.855104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec743715c294e29b3ea4c8f9be02a50)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:17.862206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:17.885690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d8c4e7c38f4d389c7b7f5fd5e1163c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.905283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d8c4e7c38f4d389c7b7f5fd5e1163c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.908373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d8c4e7c38f4d389c7b7f5fd5e1163c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.909079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d8c4e7c38f4d389c7b7f5fd5e1163c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.948884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d8c4e7c38f4d389c7b7f5fd5e1163c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:17.990683 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 837/1671] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:17 2022] DELETE /identity/v3/users/e4d8c4e7c38f4d389c7b7f5fd5e1163c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:17.991615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.002866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.049555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec743715c294e29b3ea4c8f9be02a50', 'request_id': 'req-4622f10d-a9e0-4cde-876c-5e238c14d965'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.060353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:18.061546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:18.065590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec743715c294e29b3ea4c8f9be02a50', 'request_id': 'req-4622f10d-a9e0-4cde-876c-5e238c14d965'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.085701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec743715c294e29b3ea4c8f9be02a50', 'request_id': 'req-4622f10d-a9e0-4cde-876c-5e238c14d965'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.123738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] The token cache is being invalidate because project 1ec743715c294e29b3ea4c8f9be02a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:18.124123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.128139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4622f10d-a9e0-4cde-876c-5e238c14d965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.132450 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 835/1672] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:17 2022] DELETE /identity/v3/projects/1ec743715c294e29b3ea4c8f9be02a50 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:18.137394 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c81f-0c29-4d96-a7e1-bd2b54defe38 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.137683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c81f-0c29-4d96-a7e1-bd2b54defe38 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.137968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c81f-0c29-4d96-a7e1-bd2b54defe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.197106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8125f4-88a1-49a9-bbc1-e28f624f6a8f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.211786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ddf5c81f-0c29-4d96-a7e1-bd2b54defe38 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.213267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ddf5c81f-0c29-4d96-a7e1-bd2b54defe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.334012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.334682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.334971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.335254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] PATH_INFO: `/v3/projects/fbf88444701d477f8821f9ae753d30fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.336635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf88444701d477f8821f9ae753d30fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.340225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.424730 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 836/1673] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:18.450856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db762d-4990-4307-9ed3-1376891843f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.451170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db762d-4990-4307-9ed3-1376891843f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.464208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db762d-4990-4307-9ed3-1376891843f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.495756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf88444701d477f8821f9ae753d30fe', 'request_id': 'req-7f6e699b-6565-4790-8aac-7666f63c156a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.515410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf88444701d477f8821f9ae753d30fe', 'request_id': 'req-7f6e699b-6565-4790-8aac-7666f63c156a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.538150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf88444701d477f8821f9ae753d30fe', 'request_id': 'req-7f6e699b-6565-4790-8aac-7666f63c156a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.556408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b7db762d-4990-4307-9ed3-1376891843f8 None None] MFA Rules not processed for user `6c25edc908fd43c8b6c77f32d5039089`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.557652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b7db762d-4990-4307-9ed3-1376891843f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.566676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] The token cache is being invalidate because project fbf88444701d477f8821f9ae753d30fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:18.567228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.567851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7f6e699b-6565-4790-8aac-7666f63c156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:18.580019 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 838/1674] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:17 2022] DELETE /identity/v3/projects/fbf88444701d477f8821f9ae753d30fe => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:18.582499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.582499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.582499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.646621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.648106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.780461 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 837/1675] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:18.782499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.782789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.783183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.807806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:18.834866 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 839/1676] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:18.838895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.852484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb3bae-0027-42b0-aef9-8b256ca8356e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.857060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:18.858611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.862318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.863099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.863453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.863736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.864600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:18.864911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.866549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.880530 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 838/1677] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:18.887627 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 840/1678] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:18:18.888876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.889072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:18.891114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:18.904261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799ea8-490a-426e-a221-1c24d64b8bf4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.912217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.912869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.913208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.913440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.914133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.916262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51527b9-6466-4829-8a54-eee0b4fb7f89 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.921564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fa28f-77a2-40ed-94a3-cd3bf0ecba23 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:18.931959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:18.932637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.932920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.933197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] PATH_INFO: `/v3/users/4d5e6e88e3bd4535bfb540e8dc1d98f1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:18.940271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5e6e88e3bd4535bfb540e8dc1d98f1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:18.942781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:18.960823 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 841/1679] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:18.972110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a39a23-69c0-46ed-9cc6-b0090b55dd82 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:18.972492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a39a23-69c0-46ed-9cc6-b0090b55dd82 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:18.974781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a39a23-69c0-46ed-9cc6-b0090b55dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.012386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-64a39a23-69c0-46ed-9cc6-b0090b55dd82 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:19.013642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-64a39a23-69c0-46ed-9cc6-b0090b55dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.028036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5e6e88e3bd4535bfb540e8dc1d98f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:19.042518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5e6e88e3bd4535bfb540e8dc1d98f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:19.043198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5e6e88e3bd4535bfb540e8dc1d98f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:19.049673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:19.057552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5e6e88e3bd4535bfb540e8dc1d98f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:19.084353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5e6e88e3bd4535bfb540e8dc1d98f1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:19.096812 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 839/1680] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:18 2022] DELETE /identity/v3/users/4d5e6e88e3bd4535bfb540e8dc1d98f1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:19.097957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.100426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.108013 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 842/1681] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:19.114406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.115723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.116217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.165007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:19.168459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.258651 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 843/1682] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:19.260016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.262476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac35d1-3577-4ffb-a1aa-ba5b4bf6b844 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.273357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2ff6-040c-4aac-8c0e-51bcb9987558 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.276719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.277371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.277698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.278103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.278792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.280782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.282901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.283800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.284405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.285113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.286034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:19.286576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.288449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.302610 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 844/1683] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:19.306887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.322968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd3c4c-9111-4659-8d7e-c30628334bc1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.330599 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 840/1684] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:19 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:19.330599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.335207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.336206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.336665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.337083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.337191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.337996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.340148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.387259 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 845/1685] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:19 2022] POST /identity/v3/projects => generated 365 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:18:19.388549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.435847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f19f73-05fd-48c7-ab0d-1472d7cc8f26 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.475836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:19.557724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9888a-9291-4b80-8c88-9210a48c2dc2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.575637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.576422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.576972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.577261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.578173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.580386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.587303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.588333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.588625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.588906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.602224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.604080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.612092 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 846/1686] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:19.613248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.618874 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 841/1687] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:19.619127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.631610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe367d-3dbb-47dd-852a-1953dda9c26e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.636398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63385e-e0d2-4ef7-b22a-9599f3455dcb admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.639774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.640455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.640940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.641512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.642813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.645307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.650630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.651276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.651674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.652039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.652717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.655407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.660617 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 842/1688] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:19.665541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.679326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42920374-756d-4f9f-8b8e-e064f6194e64 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.689868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.692037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.692331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.692616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] PATH_INFO: `/v3/projects/390b489e15e5484787a7f64d5dc6af8f/users/e38586478dc74013bfad49122bb54617/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.718760 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 847/1689] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:19 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:19.724410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.727465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:19.732330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:19.747516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390b489e15e5484787a7f64d5dc6af8f, user_id=e38586478dc74013bfad49122bb54617, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.757194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.777186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb7d7-c7ec-49fe-8f1f-2cfd7104b141 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.798349 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 843/1690] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:19 2022] PUT /identity/v3/projects/390b489e15e5484787a7f64d5dc6af8f/users/e38586478dc74013bfad49122bb54617/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:19.799896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:19.919342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.920036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.920322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.920599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] PATH_INFO: `/v3/projects/6b66cafc8338464ea442d12e512749fe` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.925995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b66cafc8338464ea442d12e512749fe)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.933090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:19.981933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90eb0c9-2922-4919-b61e-ed5aae757c60 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:19.991804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:19.992642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:19.994732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:19.994732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:19.996484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:19.999727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e31f0-147a-4022-8e4d-a7c2664a6b3e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:20.005786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b66cafc8338464ea442d12e512749fe', 'request_id': 'req-2adf4071-f235-4f3e-a646-8e4fc579a4f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:20.012784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b66cafc8338464ea442d12e512749fe', 'request_id': 'req-2adf4071-f235-4f3e-a646-8e4fc579a4f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:20.019897 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b66cafc8338464ea442d12e512749fe', 'request_id': 'req-2adf4071-f235-4f3e-a646-8e4fc579a4f6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:20.025670 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 844/1691] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:20.029452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ab54-7772-4c7b-a555-aef36d08e7ef None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.032801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ab54-7772-4c7b-a555-aef36d08e7ef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.032801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ab54-7772-4c7b-a555-aef36d08e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.044833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] The token cache is being invalidate because project 6b66cafc8338464ea442d12e512749fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:20.045733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:20.048232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:20.051002 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 848/1692] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:19 2022] DELETE /identity/v3/projects/6b66cafc8338464ea442d12e512749fe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:20.058387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.060426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.125595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8cb5ab54-7772-4c7b-a555-aef36d08e7ef None None] MFA Rules not processed for user `e38586478dc74013bfad49122bb54617`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:20.128709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8cb5ab54-7772-4c7b-a555-aef36d08e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.136718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:20.189721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf4071-f235-4f3e-a646-8e4fc579a4f6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.197518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:20.198300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.198944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.200217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.201340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:20.203085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08747a-3e8e-4fe5-a25e-e6fb087815c9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:20.229449 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 849/1693] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:20.231201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.231594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.232121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.264241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:20.266311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.277942 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 850/1694] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:20.288447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.301133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541b3bd-3b70-4b64-ae01-171a7eeb0fee None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.306187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:20.307085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.307475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.307844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] PATH_INFO: `/v3/projects/136fbddccbd6424c8f9aaf7312e440a9/users/979eff85d40647c9af80cb3ec1395519/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.334360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] RBAC: Authorizing `identity:create_grant(project_id=136fbddccbd6424c8f9aaf7312e440a9, user_id=979eff85d40647c9af80cb3ec1395519, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:20.341413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:20.354712 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 845/1695] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:20.358665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca063c4-13ac-4936-ac82-e3cfe50aab86 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.359315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca063c4-13ac-4936-ac82-e3cfe50aab86 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.360729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca063c4-13ac-4936-ac82-e3cfe50aab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.373168 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 851/1696] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:20 2022] PUT /identity/v3/projects/136fbddccbd6424c8f9aaf7312e440a9/users/979eff85d40647c9af80cb3ec1395519/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:20.374941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.384797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.429444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ca063c4-13ac-4936-ac82-e3cfe50aab86 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:20.430809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ca063c4-13ac-4936-ac82-e3cfe50aab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.616631 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 846/1697] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:20.621310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.621310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.621897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.630041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab2a36-9998-438c-986a-67b172b5995f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.642184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:20.643003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.648411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.648738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.649479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:20.658426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:20.738827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] MFA Rules not processed for user `979eff85d40647c9af80cb3ec1395519`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:20.740510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:20.746002 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 852/1698] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/projects => generated 365 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:20.747019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.751185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:20.913015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9192-33ca-413f-9ec4-8cfef325ebcd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.929286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:20.929943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.930243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.930525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.931237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:20.931552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:20.933228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:20.946040 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 847/1699] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:20.946998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.962352 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 853/1700] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:20.963294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:20.976749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be045bc-c730-4767-b364-0dcb8bd8c8ab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.985737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f18ed-c5cb-4960-84cd-5eac4a7a6dfa admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:20.989486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:20.990133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:20.990421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:20.990703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:20.991391 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:20.993609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.004753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.005425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.005699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.005978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.006657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.008663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.038166 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 848/1701] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:21.038929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.065170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277e782-4f95-4efa-bd3f-25dc3c21b528 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.066042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:21.077946 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 854/1702] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:20 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:21.079067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.083197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.083846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.084159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.084438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.085117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.087038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.194698 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 849/1703] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:21 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:21.198144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.222039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ccf8-515a-4131-830a-122955b0cabd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.379479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0733dd0-dde7-4948-a0fb-15b8a8776f17 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.388312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.388494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.389275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.389412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.389785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.389964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.390278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.390522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.391847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.395479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.397131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.399695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.439130 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 850/1704] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:21 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:21.439785 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 855/1705] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:21.440050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.441159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.454212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511be15-0071-4713-8402-cec25439a423 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.463815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.465002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.465893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.466727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.466879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0936f-ba6b-43b7-a055-f7035e375e1b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.467816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.471283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.483978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.484632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.484921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.485396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] PATH_INFO: `/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0/users/6a8128c2a8c3418eb05e290220394ea4/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.508057 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 851/1706] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:21 2022] POST /identity/v3/users => generated 294 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:21.509283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.522764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0740c7d4a96348e694dc9f18dfe76bb0, user_id=6a8128c2a8c3418eb05e290220394ea4, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.523920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b747c-53bd-4710-abda-076bfea7b93c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.525957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.529546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.530257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.531130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.531617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.532431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.536386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.547839 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 856/1707] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:21 2022] PUT /identity/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0/users/6a8128c2a8c3418eb05e290220394ea4/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:21.548872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.570969 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 852/1708] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:21.576125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.608215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4390e4-1a42-4201-a67a-7687e84407e6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.654684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8995b-e3b2-4a93-ad80-55a8f6429ab4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.663017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.664243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.664661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.665737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.666637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.670278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.691084 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 857/1709] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:21.698095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.699528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:21.726265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fb116-e25f-4699-ae74-1ca683fddfc0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:21.745848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.747082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.747370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.747643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] PATH_INFO: `/v3/projects/6ce155167b064cc7a09a71c89ef661d7/users/4d9f77af451c413daf9f1ae74084148a/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.783090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:21.795200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce155167b064cc7a09a71c89ef661d7, user_id=4d9f77af451c413daf9f1ae74084148a, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.799418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.803808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:21.804542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:21.804820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:21.805090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:21.805798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:21.807457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:21.835428 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 858/1710] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:21 2022] PUT /identity/v3/projects/6ce155167b064cc7a09a71c89ef661d7/users/4d9f77af451c413daf9f1ae74084148a/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:21.836590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.842896 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 853/1711] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:21.844361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:21.874023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d1ed-fd7e-45fe-b73a-3e5cd9af6c3b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.024221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583364-97ee-42c1-bacf-2c753a1df36b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.034923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.035978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.037224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.038455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.039180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.039504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.039779 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.040099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.041430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.041629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.044745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e117f-6937-4811-b81b-8a665d265144 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.046055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.083419 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 854/1712] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:22.083623 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 859/1713] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:22.084924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:22.086859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd2c6-04ce-4650-bdf3-8ac2258590fd None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.087187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd2c6-04ce-4650-bdf3-8ac2258590fd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.087453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd2c6-04ce-4650-bdf3-8ac2258590fd None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.091354 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 860/1714] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:22.092196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fd2c6-04ce-4650-bdf3-8ac2258590fd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:22.116772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a300-b343-4d8e-993e-0fcaf048145d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.128815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fd2c6-04ce-4650-bdf3-8ac2258590fd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.132072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.132790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.133077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.133490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] PATH_INFO: `/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0/users/6a8128c2a8c3418eb05e290220394ea4/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.139249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0740c7d4a96348e694dc9f18dfe76bb0, user_id=6a8128c2a8c3418eb05e290220394ea4, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.145131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.156880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.157641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.157872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.158151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] PATH_INFO: `/v3/projects/6ce155167b064cc7a09a71c89ef661d7/users/4d9f77af451c413daf9f1ae74084148a/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.161759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce155167b064cc7a09a71c89ef661d7, user_id=4d9f77af451c413daf9f1ae74084148a, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.166249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f10f-e9ff-42dd-a9a9-ec5c7a5a3dc3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.181603 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 855/1715] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:22 2022] PUT /identity/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0/users/6a8128c2a8c3418eb05e290220394ea4/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:22.184377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:22.202174 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 861/1716] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:22 2022] PUT /identity/v3/projects/6ce155167b064cc7a09a71c89ef661d7/users/4d9f77af451c413daf9f1ae74084148a/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:22.204125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db87b-5d69-4746-b463-e569137532d2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.204319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db87b-5d69-4746-b463-e569137532d2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.204573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5db87b-5d69-4746-b463-e569137532d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.257142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bb5db87b-5d69-4746-b463-e569137532d2 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:22.258526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bb5db87b-5d69-4746-b463-e569137532d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:22.375255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47979113-7839-49e5-a2e1-dd5e9840a4a8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.457778 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 862/1717] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:22.459252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.459546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.459827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.489399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:22.539632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.540871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.541159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.542442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] PATH_INFO: `/v3/projects/ad9da5d972ea475aac183b0fefa653f3/users/942a064c083f4961b762e133485d1d7c/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.564772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] MFA Rules not processed for user `6a8128c2a8c3418eb05e290220394ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:22.566069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:22.596810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9da5d972ea475aac183b0fefa653f3, user_id=942a064c083f4961b762e133485d1d7c, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.626223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0253e-fbbf-4618-acbe-d012525498b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:22.659262 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 856/1718] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:22 2022] PUT /identity/v3/projects/ad9da5d972ea475aac183b0fefa653f3/users/942a064c083f4961b762e133485d1d7c/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:22.661349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf585b-f00c-43f9-a83d-82e2b704733c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.662727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf585b-f00c-43f9-a83d-82e2b704733c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.663196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf585b-f00c-43f9-a83d-82e2b704733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.770940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:22.800478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-19bf585b-f00c-43f9-a83d-82e2b704733c None None] MFA Rules not processed for user `4d9f77af451c413daf9f1ae74084148a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:22.807697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19bf585b-f00c-43f9-a83d-82e2b704733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:22.814029 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 863/1719] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:22.814029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:22.817962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:22.846074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18412e-4a28-4d26-96e1-71637c2cc305 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:22.976809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:22.977490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:22.977774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:22.978054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] PATH_INFO: `/v3/projects/0a140f9b83f44aefbfe55928b6dab5da` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:22.983125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a140f9b83f44aefbfe55928b6dab5da)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:22.986263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:23.048533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 857/1720] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:23.050057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480066-cf0d-414e-9873-2652aafc8e75 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:23.050348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480066-cf0d-414e-9873-2652aafc8e75 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:23.050629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51480066-cf0d-414e-9873-2652aafc8e75 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:23.056163 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 858/1721] 10.222.0.47 () {54 vars in 961 bytes} [Sun Jul 31 01:18:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:23.057520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:23.057815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:23.058719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:23.107306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a140f9b83f44aefbfe55928b6dab5da', 'request_id': 'req-e1c7dce8-acb6-4351-9297-d4354917e514'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:23.117747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a140f9b83f44aefbfe55928b6dab5da', 'request_id': 'req-e1c7dce8-acb6-4351-9297-d4354917e514'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:23.130982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a140f9b83f44aefbfe55928b6dab5da', 'request_id': 'req-e1c7dce8-acb6-4351-9297-d4354917e514'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:23.161329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] MFA Rules not processed for user `942a064c083f4961b762e133485d1d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:23.162393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.165215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] The token cache is being invalidate because project 0a140f9b83f44aefbfe55928b6dab5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:23.165829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:23.174369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:23.182811 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 864/1722] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:22 2022] DELETE /identity/v3/projects/0a140f9b83f44aefbfe55928b6dab5da => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:23.186959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:23.189144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.369895 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 859/1723] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:23.377218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:23.380250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7dce8-acb6-4351-9297-d4354917e514 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:23.382865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.402076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:23.402642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:23.402925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:23.403219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:23.405151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.416782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4d0ee-3c33-4711-81a5-b13c165a7514 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:23.425133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:23.426436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:23.426916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:23.427383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:23.432386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.528750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:23.586004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:23.586294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947403-cfe6-4161-8e50-c0403e73cb3b service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:23.601466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:23.613448 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 865/1724] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:23.614967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:23.615457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:23.616191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:23.686533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:23.691390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.700658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:23.702184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:23.752393 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 860/1725] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:23.754069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:23.757894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.936972 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 866/1726] 10.222.0.47 () {58 vars in 1058 bytes} [Sun Jul 31 01:18:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:23.938786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:23.949207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:23.996168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb0310-4018-4e11-a2cb-be61fef206d8 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:24.011479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:24.012524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.012955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.013341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] PATH_INFO: `/v3/users/df0389dbba864d2bbcff5284c27fe8cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.015789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0389dbba864d2bbcff5284c27fe8cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:24.020640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:24.138650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0389dbba864d2bbcff5284c27fe8cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:24.151459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0389dbba864d2bbcff5284c27fe8cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:24.152282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0389dbba864d2bbcff5284c27fe8cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:24.166673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afe2d3-7f27-4f2b-a84c-217d6e34efd5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:24.168146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0389dbba864d2bbcff5284c27fe8cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:24.214605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0389dbba864d2bbcff5284c27fe8cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:24.221246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:24.222225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.222427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.223044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.223878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:24.226868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:24.243304 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 861/1727] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:23 2022] DELETE /identity/v3/users/df0389dbba864d2bbcff5284c27fe8cb => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:24.244375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:24.246988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.295726 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 867/1728] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:23 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:24.301489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:24.305537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.421667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2480d-1601-4ee0-8675-635c209f70fb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:24.425041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5497a-0ce6-4d45-bab5-e00a6c1b5704 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:24.430212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:24.444432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:24.445405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.446366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.446645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.450625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.482285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:24.583125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:24.583963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.584533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.586782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.590871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.614438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:24.616317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbe438-dca9-4978-a8e8-d6b5ad8ddca1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:24.632878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:24.638681 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 868/1729] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:24.639793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.641364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.641663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:24.641834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.664687 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 862/1730] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:24.665532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:24.666882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.708088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] MFA Rules not processed for user `e117c5cc43a34179b69ac8ba1529b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:24.710305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:24.861500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606438f-ca03-4d1b-a008-9133082dbbe5 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:24.871704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:24.872809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.873296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.874013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:24.874914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:24.878439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f76e5b-663f-4ae7-9178-3fc86e2fe592 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:24.931898 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 863/1731] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:24 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:24.933574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:24.935358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:24.935796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.006528 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 869/1732] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:25.009053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.019084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.049508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] MFA Rules not processed for user `9857d08d4d7a46e3a377e2d60673ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:25.050780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.098925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b4370-c8e0-4312-b49e-5c2e3239d13c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:25.119348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:25.121511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.126024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.128056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] PATH_INFO: `/v3/users/e38586478dc74013bfad49122bb54617` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.131979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38586478dc74013bfad49122bb54617)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:25.138348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:25.258276 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 864/1733] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:25.266768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38586478dc74013bfad49122bb54617'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:25.278731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.280734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38586478dc74013bfad49122bb54617'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:25.283748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38586478dc74013bfad49122bb54617'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:25.286483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38586478dc74013bfad49122bb54617'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:25.309260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059059-d7e1-464b-9668-bdd94368b9f5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:25.310289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38586478dc74013bfad49122bb54617'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:25.323728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:25.324415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.324705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.324990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.325712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:25.330235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:25.333578 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 870/1734] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:25 2022] DELETE /identity/v3/users/e38586478dc74013bfad49122bb54617 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:25.340986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.344182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.355197 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 865/1735] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:25.355197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.362405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.372853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:25.379243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:25.483901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6e94d-0c2b-4938-9d7b-9935a6676878 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:25.545320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda242b-d55f-4a3c-b231-91a119756fd2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:25.563369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:25.566635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.567020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.567315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.570824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.593301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:25.594998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.595739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.596047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.598107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.702137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:25.704704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec5fc-c33c-4df1-9c64-d370bef071fb service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:25.717213 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 866/1736] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:25.719221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:25.720879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:25.730473 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.732632 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 871/1737] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:25.733465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.735362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.750752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.756700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.780086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:25.781971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.869508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237fe3b-9d10-49ae-9f04-868b4e447d5d service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:25.877773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:25.878652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:25.879131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:25.879611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] PATH_INFO: `/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc/users/39966db2ccc64a768994f3b3f1b38042/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:25.902815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:25.915677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860a2c1e6c9d483bb205636ac8ebb7cc, user_id=39966db2ccc64a768994f3b3f1b38042, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:25.918478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:25.959329 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 872/1738] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:25 2022] PUT /identity/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc/users/39966db2ccc64a768994f3b3f1b38042/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:25.963059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.967036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:25.974338 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 867/1739] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:25.976130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:25.980244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.013567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdff5c-4f9a-4e9c-9e0f-6ade4429c42c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:26.146138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:26.151186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:26.153717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.154027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.154314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] PATH_INFO: `/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.159044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e612b91cc2d8447d8ef8fab59d4cc874)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:26.164937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:26.228300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8162f9-ab88-4706-8e7c-bcc853cd8fb0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:26.235154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:26.236715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.237200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.237622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] PATH_INFO: `/v3/users/a91d548b76124ecaa338f5fccfd043bc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.239823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91d548b76124ecaa338f5fccfd043bc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:26.243224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:26.303444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e612b91cc2d8447d8ef8fab59d4cc874', 'request_id': 'req-00edab8c-056a-4286-bc78-cb3b87911dee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.328881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e612b91cc2d8447d8ef8fab59d4cc874', 'request_id': 'req-00edab8c-056a-4286-bc78-cb3b87911dee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.350029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e612b91cc2d8447d8ef8fab59d4cc874', 'request_id': 'req-00edab8c-056a-4286-bc78-cb3b87911dee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.382906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] The token cache is being invalidate because project e612b91cc2d8447d8ef8fab59d4cc874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:26.383670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.384617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.389622 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 868/1740] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:25 2022] DELETE /identity/v3/projects/e612b91cc2d8447d8ef8fab59d4cc874 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:26.389622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:26.392261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91d548b76124ecaa338f5fccfd043bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.394287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.421288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91d548b76124ecaa338f5fccfd043bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.422828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91d548b76124ecaa338f5fccfd043bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.423646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91d548b76124ecaa338f5fccfd043bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.488225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91d548b76124ecaa338f5fccfd043bc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:26.534767 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 873/1741] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:25 2022] DELETE /identity/v3/users/a91d548b76124ecaa338f5fccfd043bc => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:26.535774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:26.537263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.569866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edab8c-056a-4286-bc78-cb3b87911dee admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:26.614629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:26.702644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:26.704360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.704685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.705340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.706738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:26.709015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c77df8-32f3-47dc-90fe-2ad8b937fff6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:26.723753 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 869/1742] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:26.725105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de340-6d1e-4c92-a53d-3547ce47dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.725539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de340-6d1e-4c92-a53d-3547ce47dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.726056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2de340-6d1e-4c92-a53d-3547ce47dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.736208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af753e-df1c-495a-901c-23ce89d8a010 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:26.757079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:26.757898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.758293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.758680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.759210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8a2de340-6d1e-4c92-a53d-3547ce47dfc8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:26.761277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a2de340-6d1e-4c92-a53d-3547ce47dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.762932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.778156 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 870/1743] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:26.778156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b97f-fdb3-4351-8b88-19091b5acd17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.778156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b97f-fdb3-4351-8b88-19091b5acd17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.778156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8b97f-fdb3-4351-8b88-19091b5acd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.809378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:26.812847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:26.831151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aba8b97f-fdb3-4351-8b88-19091b5acd17 None None] MFA Rules not processed for user `bd896e56eee346018faf5c4e09f47c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:26.832986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aba8b97f-fdb3-4351-8b88-19091b5acd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.846519 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 874/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:26.853102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:26.858751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:26.899309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18040b0-af5a-4779-8322-6b38b636b9ba service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:26.927347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:26.928319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.928660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:26.929051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] PATH_INFO: `/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc/users/39966db2ccc64a768994f3b3f1b38042/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:26.933604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860a2c1e6c9d483bb205636ac8ebb7cc, user_id=39966db2ccc64a768994f3b3f1b38042, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:26.938050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7b116-b21a-4cb4-b5d6-541211dcc713 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:26.992403 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 875/1745] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:26 2022] PUT /identity/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc/users/39966db2ccc64a768994f3b3f1b38042/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:26.995456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122c01-d2dc-4b03-a9c8-35e4e97c6093 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:26.995865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122c01-d2dc-4b03-a9c8-35e4e97c6093 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.003738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93122c01-d2dc-4b03-a9c8-35e4e97c6093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.010606 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 871/1746] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:27.012298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.034123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.034427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.064287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-93122c01-d2dc-4b03-a9c8-35e4e97c6093 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:27.067434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-93122c01-d2dc-4b03-a9c8-35e4e97c6093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.166810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:27.187994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] MFA Rules not processed for user `39966db2ccc64a768994f3b3f1b38042`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:27.190078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.221236 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 876/1747] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:27.222863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.223155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.223440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.283730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] MFA Rules not processed for user `bd896e56eee346018faf5c4e09f47c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:27.291621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.355259 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 872/1748] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:27.356170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:27.380099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dea69b-7289-4f47-b9f0-218ad43a29c5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:27.393648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:27.393811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.394104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.394388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.395085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:27.395540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:27.397232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:27.462726 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 873/1749] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:27.469015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:27.483500 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 877/1750] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:27.487637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.494058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:27.495520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.524463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2461da-c9de-40ea-a621-c4d62e1ce870 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:27.534347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:27.536807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:27.537568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.537843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.538210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] PATH_INFO: `/v3/projects/e4376b49b44144a39f4af03fc462b61b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.540534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4376b49b44144a39f4af03fc462b61b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:27.542868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:27.649982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4376b49b44144a39f4af03fc462b61b', 'request_id': 'req-c53931c5-0bc1-44bf-8f7a-406825420033'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:27.663826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4376b49b44144a39f4af03fc462b61b', 'request_id': 'req-c53931c5-0bc1-44bf-8f7a-406825420033'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:27.684018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4376b49b44144a39f4af03fc462b61b', 'request_id': 'req-c53931c5-0bc1-44bf-8f7a-406825420033'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:27.706612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] The token cache is being invalidate because project e4376b49b44144a39f4af03fc462b61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:27.706919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:27.709606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:27.713529 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 878/1751] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:27 2022] DELETE /identity/v3/projects/e4376b49b44144a39f4af03fc462b61b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:27.715752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:27.721247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.740493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51d8a5-f504-4024-9011-56e2f19e6757 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:27.851903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:27.852580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.852874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.853158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.857060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:27.859792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53931c5-0bc1-44bf-8f7a-406825420033 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:27.868028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:27.869427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:27.870071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:27.870560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:27.871483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:27.876022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:27.932978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:27.956105 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 879/1752] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:27 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:27.956356 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:27.959272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.049233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.055565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.085422 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 874/1753] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:28.086789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.089052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.105387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a476efe-dce6-4163-a69f-74263bed6624 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.108705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929d05b-a733-4fe2-8b66-39cff19b7f71 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.113022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.114019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.114247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.114458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.116942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.192299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.194245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.194673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.195061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] PATH_INFO: `/v3/users/6c25edc908fd43c8b6c77f32d5039089` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.196557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c25edc908fd43c8b6c77f32d5039089)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.198713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.204810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.206876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.232783 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 880/1754] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:28.234272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.241402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:28.260055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd554-2b38-4fec-9ccc-72971abe3a8a service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.268467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.269896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.269896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.270393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.271333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.274122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.303796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c25edc908fd43c8b6c77f32d5039089'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.309725 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 881/1755] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:28 2022] POST /identity/v3/users => generated 291 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:28.311522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.319691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c25edc908fd43c8b6c77f32d5039089'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.320422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.321195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c25edc908fd43c8b6c77f32d5039089'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.340329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c25edc908fd43c8b6c77f32d5039089'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.341128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34326-2c21-4ff6-b190-9b3dbfe0184e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.347525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.348399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.348697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.348975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] PATH_INFO: `/v3/projects/390b489e15e5484787a7f64d5dc6af8f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.350360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] RBAC: Authorizing `identity:delete_project(project_id=390b489e15e5484787a7f64d5dc6af8f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.352734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.381393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c25edc908fd43c8b6c77f32d5039089'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.404950 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 875/1756] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:28 2022] DELETE /identity/v3/users/6c25edc908fd43c8b6c77f32d5039089 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:28.404950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.407919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.456913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390b489e15e5484787a7f64d5dc6af8f', 'request_id': 'req-c7b5f3dd-e936-4389-8e2a-77daf059602d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.472222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390b489e15e5484787a7f64d5dc6af8f', 'request_id': 'req-c7b5f3dd-e936-4389-8e2a-77daf059602d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.495666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390b489e15e5484787a7f64d5dc6af8f', 'request_id': 'req-c7b5f3dd-e936-4389-8e2a-77daf059602d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.514296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:28.525627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] The token cache is being invalidate because project 390b489e15e5484787a7f64d5dc6af8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:28.525944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.529238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.532519 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 882/1757] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:28 2022] DELETE /identity/v3/projects/390b489e15e5484787a7f64d5dc6af8f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:28.533458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.538851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.711918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b2f5-d89c-41e3-9543-d7b60abb9275 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.809365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5f3dd-e936-4389-8e2a-77daf059602d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.817670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.818546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.819193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.819924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.821477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.824307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.838861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 883/1758] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:28.839992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:28.844571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:28.866159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc4b3-084a-4e58-8a31-5f30ed3e395f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:28.872503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.873540 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.874159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.874581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] PATH_INFO: `/v3/users/6a8128c2a8c3418eb05e290220394ea4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.877049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8128c2a8c3418eb05e290220394ea4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.879489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.886177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:28.887274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:28.887657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:28.888056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] PATH_INFO: `/v3/users/942a064c083f4961b762e133485d1d7c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:28.889866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942a064c083f4961b762e133485d1d7c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:28.892675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:28.951662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8128c2a8c3418eb05e290220394ea4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.964848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8128c2a8c3418eb05e290220394ea4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.966117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8128c2a8c3418eb05e290220394ea4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.967319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8128c2a8c3418eb05e290220394ea4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:28.988686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8128c2a8c3418eb05e290220394ea4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.014347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:29.024545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942a064c083f4961b762e133485d1d7c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.025595 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 884/1759] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:28 2022] DELETE /identity/v3/users/6a8128c2a8c3418eb05e290220394ea4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:29.026496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:29.033424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.040709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942a064c083f4961b762e133485d1d7c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.041344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942a064c083f4961b762e133485d1d7c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.058430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942a064c083f4961b762e133485d1d7c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.088913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942a064c083f4961b762e133485d1d7c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.101658 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 876/1760] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:28 2022] DELETE /identity/v3/users/942a064c083f4961b762e133485d1d7c => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:29.104846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:29.115698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.165529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe321-de3f-4ba0-baae-2ba1dbe31c65 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:29.184459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:29.336056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc577e-fced-40db-a0e1-90c758cea1b4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:29.342736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:29.343388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.344256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.344523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.346856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:29.347702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:29.348544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:29.350190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.350482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.350764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] PATH_INFO: `/v3/users/979eff85d40647c9af80cb3ec1395519` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.364366 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 877/1761] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:29.365336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:29.367371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.367757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=979eff85d40647c9af80cb3ec1395519)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:29.376385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:29.383852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0dd6-e191-420d-b70a-15f7f36f8328 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:29.396437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:29.397113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.397405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.397687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] PATH_INFO: `/v3/projects/c69eaa27f35e4b009de9d70b38c5f600` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.399436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69eaa27f35e4b009de9d70b38c5f600)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:29.402751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:29.458764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979eff85d40647c9af80cb3ec1395519'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.473249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979eff85d40647c9af80cb3ec1395519'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.475338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979eff85d40647c9af80cb3ec1395519'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.476170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979eff85d40647c9af80cb3ec1395519'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.504200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69eaa27f35e4b009de9d70b38c5f600', 'request_id': 'req-886c593e-aade-40fb-9a5c-333f663a1d98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.512737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fee6279a-f226-4e0b-8f63-6f3e981f1b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979eff85d40647c9af80cb3ec1395519'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.520493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69eaa27f35e4b009de9d70b38c5f600', 'request_id': 'req-886c593e-aade-40fb-9a5c-333f663a1d98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.533667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69eaa27f35e4b009de9d70b38c5f600', 'request_id': 'req-886c593e-aade-40fb-9a5c-333f663a1d98'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.544644 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 885/1762] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:29 2022] DELETE /identity/v3/users/979eff85d40647c9af80cb3ec1395519 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:29.545945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608805-045f-48f3-ba50-60b6069e58f2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.546239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608805-045f-48f3-ba50-60b6069e58f2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.546517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54608805-045f-48f3-ba50-60b6069e58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.553632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] The token cache is being invalidate because project c69eaa27f35e4b009de9d70b38c5f600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:29.553934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.554753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-886c593e-aade-40fb-9a5c-333f663a1d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:29.560235 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 878/1763] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:29 2022] DELETE /identity/v3/projects/c69eaa27f35e4b009de9d70b38c5f600 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:29.564326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.564712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.565096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.566590 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 879/1764] 10.222.0.47 () {54 vars in 912 bytes} [Sun Jul 31 01:18:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:29.570061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:29.585860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.596745 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-54608805-045f-48f3-ba50-60b6069e58f2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:29.601581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-54608805-045f-48f3-ba50-60b6069e58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.685249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:29.745503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384fc02-15c6-4b0a-a919-d07f10c3eb9b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:29.754123 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 886/1765] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:29.754625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425fab-1f9c-496c-8e4d-aa93cadcfe64 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.756145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425fab-1f9c-496c-8e4d-aa93cadcfe64 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.757008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:29.757417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4425fab-1f9c-496c-8e4d-aa93cadcfe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.760379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.760796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.761197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] PATH_INFO: `/v3/projects/8ef2efab238b44dc8b8a50b9516da13c/users/68a7cfed743f40d09a40526b537bd0ee/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.807212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c4425fab-1f9c-496c-8e4d-aa93cadcfe64 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:29.808731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c4425fab-1f9c-496c-8e4d-aa93cadcfe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.811820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef2efab238b44dc8b8a50b9516da13c, user_id=68a7cfed743f40d09a40526b537bd0ee, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:29.815232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76856ae6-fe39-4752-884f-84c77669813e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:29.833782 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 887/1766] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:29.839016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.839343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.840098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.849925 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 880/1767] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:29 2022] PUT /identity/v3/projects/8ef2efab238b44dc8b8a50b9516da13c/users/68a7cfed743f40d09a40526b537bd0ee/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:29.855184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:29.855476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:29.858921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:29.884311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:29.888527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.928060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:29.929641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:29.941413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:30.010366 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 881/1768] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:30.012391 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.021825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.024681 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 888/1769] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:30.025549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.028324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.046096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e381-897d-4e0f-8af4-a56802cba448 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.054388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b64c64-63c9-435b-be98-d65d43f317e0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.056748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.057471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.057784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.058029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.060766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.063591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.064249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.064651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.069783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.071320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48673551-dffb-4212-96ba-461190e87f9e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.078693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.080452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466b85-1e40-4dcd-ae99-9a6dfb92c201 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.098913 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 889/1770] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:30.100292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.100589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.100875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.107254 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 882/1771] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:30.111331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6ac8-26e3-4b41-8b38-4c3fbbacd2ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.111623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6ac8-26e3-4b41-8b38-4c3fbbacd2ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.111908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df6ac8-26e3-4b41-8b38-4c3fbbacd2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.137968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] MFA Rules not processed for user `68a7cfed743f40d09a40526b537bd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:30.139255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.168755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1df6ac8-26e3-4b41-8b38-4c3fbbacd2ba None None] MFA Rules not processed for user `9857d08d4d7a46e3a377e2d60673ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:30.171367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1df6ac8-26e3-4b41-8b38-4c3fbbacd2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.300872 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 890/1772] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:30.302817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.353070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae0a1b-6768-44c7-9d43-c8aa0f0599a1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.378144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.383695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.384232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.384813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.393233 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 883/1773] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:30.396307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.396636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.396935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.409926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.412159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.427051 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 891/1774] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:30.427999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.430191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.451140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecf4d5-40c1-424a-8223-2a59cc03bb09 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.452035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:30.453358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.459539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.461048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.461348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.461634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] PATH_INFO: `/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.463188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0740c7d4a96348e694dc9f18dfe76bb0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.480982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.487687 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 884/1775] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:30.487687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.514919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96a36b-7c96-4fe0-95a0-c10eacb27f84 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.531625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.532657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.532794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.533052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.533739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.539496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.612127 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 885/1776] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:30.612127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.668103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:30.693633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0740c7d4a96348e694dc9f18dfe76bb0', 'request_id': 'req-6072355b-f6ef-4c08-8739-ce620b1d63d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:30.713539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0740c7d4a96348e694dc9f18dfe76bb0', 'request_id': 'req-6072355b-f6ef-4c08-8739-ce620b1d63d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:30.727510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0740c7d4a96348e694dc9f18dfe76bb0', 'request_id': 'req-6072355b-f6ef-4c08-8739-ce620b1d63d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:30.755794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] The token cache is being invalidate because project 0740c7d4a96348e694dc9f18dfe76bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:30.756092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:30.763269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:30.768511 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 892/1777] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:30 2022] DELETE /identity/v3/projects/0740c7d4a96348e694dc9f18dfe76bb0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:30.775075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6d2b7-3b3f-4f5a-9dfc-792f5cf624da admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:30.780308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:30.785121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:30.839225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:30.974812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:30.975578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:30.976120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:30.976500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:30.977408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:30.977839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:30.984983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482e542-a873-480c-8702-f7144e38cfd8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:30.998853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072355b-f6ef-4c08-8739-ce620b1d63d7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.009441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.009915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.010199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.010483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.011155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.013711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.016519 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 886/1778] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:31.018223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.019913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.020372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.067209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:31.068365 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 893/1779] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:30 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:31.068709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:31.071582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.081402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:31.091197 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 887/1780] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:31.092260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.103113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673a99-6880-4d73-8b31-ae335bb53c89 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.114985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4d692-8379-41f7-ad89-c202ba49a897 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.116172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.116828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.117114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.117397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.118197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.129819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.130533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.130915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.131266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.132089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.132772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.133995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e74250-e163-4e69-b435-1c9840246565 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.163604 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 888/1781] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:31.164987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.165346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.165760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.199740 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 894/1782] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:31.203671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.208990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:31.215411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:31.345919 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 889/1783] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:31.347461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.364305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12acf32-3717-454e-b24d-2de4da9eba12 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.371140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.372712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.373317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.373750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.374586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.377150 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.390077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abe3e5-7439-4f35-8506-bb1ea9eae5e5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.402791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.404814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.405131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.405417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] PATH_INFO: `/v3/projects/96e4b0afe8184779b197492a5361371e/users/df129646f6b8415f9782f861761974ea/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.416919 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 890/1784] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:31.418985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.441946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeabbb-469e-491f-9524-5fda8882b075 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.444956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e4b0afe8184779b197492a5361371e, user_id=df129646f6b8415f9782f861761974ea, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.448192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.455589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.456864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.457957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.458396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.462100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:31.462605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.466898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.477061 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 895/1785] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:31 2022] PUT /identity/v3/projects/96e4b0afe8184779b197492a5361371e/users/df129646f6b8415f9782f861761974ea/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:31.478475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.506048 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 891/1786] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:31.506935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.519828 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84715b-9a0a-4ac4-a6f9-415be0f8dd96 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.535920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:31.607152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db8019-c65d-4420-bda5-0f9b332fb199 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.616928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.617848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.618207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.618593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.619575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.621669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.629303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:31.636495 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 896/1787] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:31.638017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.638435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.639149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.639696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.640303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.641179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.643090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.652314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0caf62-8e6f-4ebe-b8c8-1318264a23a8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.659783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.660632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.661063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.661439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.662266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.664480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.670685 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 892/1788] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:31.677098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.700183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7518db-5707-440a-91e4-cdac1793e047 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.718193 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 897/1789] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:31.718193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.728136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.728315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.728562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.728845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.729555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.735371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.749653 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 893/1790] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:31.755653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.768552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a343a-b8cf-48c5-803d-f7da0d21dd3a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.839733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.840584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.840892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.841301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.842043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.845110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.873591 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 894/1791] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:31 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:31.873591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:31.875356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:31.877069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea85aa3-163e-4249-9db8-dd4c588eaa86 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.888615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50142f-6d4c-4d78-b7ec-2a3d959f1cff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:31.893758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.894682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.894908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.895260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] PATH_INFO: `/v3/projects/96e4b0afe8184779b197492a5361371e/users/df129646f6b8415f9782f861761974ea/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.897800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e4b0afe8184779b197492a5361371e, user_id=df129646f6b8415f9782f861761974ea, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.901675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.903850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:31.904665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:31.904837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:31.905120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] PATH_INFO: `/v3/projects/ad9da5d972ea475aac183b0fefa653f3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:31.907547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9da5d972ea475aac183b0fefa653f3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:31.909519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:31.926350 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 898/1792] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:31 2022] PUT /identity/v3/projects/96e4b0afe8184779b197492a5361371e/users/df129646f6b8415f9782f861761974ea/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:31.936733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.005272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9da5d972ea475aac183b0fefa653f3', 'request_id': 'req-fd3383b9-6c64-4858-b60b-dfafb49779b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.011599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9da5d972ea475aac183b0fefa653f3', 'request_id': 'req-fd3383b9-6c64-4858-b60b-dfafb49779b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.020970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9da5d972ea475aac183b0fefa653f3', 'request_id': 'req-fd3383b9-6c64-4858-b60b-dfafb49779b8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.057792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] The token cache is being invalidate because project ad9da5d972ea475aac183b0fefa653f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:32.058751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.059633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.066041 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 895/1793] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:31 2022] DELETE /identity/v3/projects/ad9da5d972ea475aac183b0fefa653f3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:32.067119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.070286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.091855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5f5aa-2d74-4aee-ba34-69d3487dd259 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.110290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:32.255259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3383b9-6c64-4858-b60b-dfafb49779b8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.255509 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.271214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.271993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.272382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.272762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] PATH_INFO: `/v3/projects/136fbddccbd6424c8f9aaf7312e440a9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.274958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=136fbddccbd6424c8f9aaf7312e440a9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:32.277024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:32.284269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.284558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.288291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] PATH_INFO: `/v3/projects/4c716455d8434aaf9244fc4f715263f4/users/dbdc259e7efd41eeb9452dada5c40991/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.332941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c716455d8434aaf9244fc4f715263f4, user_id=dbdc259e7efd41eeb9452dada5c40991, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:32.339229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3f2d5-41b3-46b1-8dab-2e74e6da8ac8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:32.388638 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 899/1794] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:31 2022] PUT /identity/v3/projects/4c716455d8434aaf9244fc4f715263f4/users/dbdc259e7efd41eeb9452dada5c40991/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:32.393058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badfea-4c1f-48d9-ba73-8d710a4d27f8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.393627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badfea-4c1f-48d9-ba73-8d710a4d27f8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.394109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9badfea-4c1f-48d9-ba73-8d710a4d27f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.406538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:32.409906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136fbddccbd6424c8f9aaf7312e440a9', 'request_id': 'req-cd19b419-ffa5-4ec9-aa68-5761c664aaca'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.423117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136fbddccbd6424c8f9aaf7312e440a9', 'request_id': 'req-cd19b419-ffa5-4ec9-aa68-5761c664aaca'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.436233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136fbddccbd6424c8f9aaf7312e440a9', 'request_id': 'req-cd19b419-ffa5-4ec9-aa68-5761c664aaca'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.445079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d9badfea-4c1f-48d9-ba73-8d710a4d27f8 None None] MFA Rules not processed for user `e117c5cc43a34179b69ac8ba1529b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:32.447370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d9badfea-4c1f-48d9-ba73-8d710a4d27f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.454128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] The token cache is being invalidate because project 136fbddccbd6424c8f9aaf7312e440a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:32.454752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.455469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cd19b419-ffa5-4ec9-aa68-5761c664aaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.457320 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 896/1795] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:32 2022] DELETE /identity/v3/projects/136fbddccbd6424c8f9aaf7312e440a9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:32.458798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.459088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.459363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.461885 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 897/1796] 10.222.0.47 () {54 vars in 912 bytes} [Sun Jul 31 01:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:32.461885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.463714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.532524 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 900/1797] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:32.533844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.534136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.534412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.566762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] MFA Rules not processed for user `df129646f6b8415f9782f861761974ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:32.568567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.584721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc5d90-2a36-4e81-acd5-f21ef1177c62 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.589745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.590387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.590675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.590957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.591666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:32.600613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:32.618011 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 898/1798] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:32.619055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.620922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.641152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6791f8-f4ae-454f-814e-9a800ce1e899 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.650842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.651652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.652093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.652464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] PATH_INFO: `/v3/users/39966db2ccc64a768994f3b3f1b38042` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.654340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39966db2ccc64a768994f3b3f1b38042)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:32.657845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:32.728044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:32.729811 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 901/1799] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:32.730937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.732653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.744750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39966db2ccc64a768994f3b3f1b38042'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.755977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39966db2ccc64a768994f3b3f1b38042'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.758728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39966db2ccc64a768994f3b3f1b38042'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.774871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39966db2ccc64a768994f3b3f1b38042'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.798060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f1c396b9-8deb-44d6-bb41-bd4d0f443ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39966db2ccc64a768994f3b3f1b38042'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:32.810858 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 899/1800] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:32 2022] DELETE /identity/v3/users/39966db2ccc64a768994f3b3f1b38042 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:32.811527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.812870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.813117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.851110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865af6f-f598-40b2-a34d-4bf30f772925 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:32.853550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] MFA Rules not processed for user `dbdc259e7efd41eeb9452dada5c40991`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:32.855023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.930301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:32.966370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 900/1801] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:32.968496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:32.969867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:32.987022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:32.987739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:32.988686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:32.989199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:32.992204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.007407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.009474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf957-82fa-4a1b-9bcb-f78b3efaa01d service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.022402 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 902/1802] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:33.023758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.024081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.024368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.051760 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:33.053705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.126381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3746b00-6122-4952-aae5-2025981d7226 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.143138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.144205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.144492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.145275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] PATH_INFO: `/v3/users/4d9f77af451c413daf9f1ae74084148a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.147583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9f77af451c413daf9f1ae74084148a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.153395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.160175 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 903/1803] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:33.161379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.163316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.184701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbf56f-3fd7-4088-a882-a01b0f8a59b6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.194537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.195377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.195809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.196269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.197121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.198865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.223044 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 904/1804] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:33.224726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.227167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.247740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:33.254296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9f77af451c413daf9f1ae74084148a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:33.268301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9f77af451c413daf9f1ae74084148a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:33.269781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9f77af451c413daf9f1ae74084148a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:33.310603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9f77af451c413daf9f1ae74084148a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:33.329105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a5b75-6e6f-4509-a932-84714c9bede8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.354256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9f77af451c413daf9f1ae74084148a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:33.358219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.366290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.368218 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 901/1805] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:32 2022] DELETE /identity/v3/users/4d9f77af451c413daf9f1ae74084148a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:33.369169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.369736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.370760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.371804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.380820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.508180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.510449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.548369 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 905/1806] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:33.549911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.553578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.594953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1127-2cca-4fb0-ace4-b720d3027bb2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.600610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.601036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.601371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.601665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.602844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.604737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb4da-3a3b-410e-89b8-8194e23edeb6 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.606434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.620973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.625521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.626810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.627201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] PATH_INFO: `/v3/projects/75ab4feb8f174175bce4a667fe816cc4/users/fd2dd5289d3b4d229a7feeb4964e9962/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.654071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:33.663843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ab4feb8f174175bce4a667fe816cc4, user_id=fd2dd5289d3b4d229a7feeb4964e9962, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.669085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.694803 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 906/1807] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:33 2022] PUT /identity/v3/projects/75ab4feb8f174175bce4a667fe816cc4/users/fd2dd5289d3b4d229a7feeb4964e9962/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:33.697190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.697673 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 902/1808] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:33 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:33.698616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:33.700271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.706495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.902908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8eaa0-b2b9-4436-b74a-aca3d74c8375 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.910342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:33.910993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:33.911321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:33.911555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:33.923314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:33.929852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec436823-1c8c-42b4-8f87-74dfdd8a11c9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:33.943728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:33.946131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:33.956524 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 903/1809] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:33.957462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.094180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.095014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.095308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.095566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] PATH_INFO: `/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.099077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860a2c1e6c9d483bb205636ac8ebb7cc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.104140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.107178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:34.152956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b377b9f-e416-490e-af65-ab58c1de888f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.163646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.165554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.167224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.168230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.171009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.179410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae55b-3401-4b49-82a4-c9be20ac60f8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.241946 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 904/1810] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:33 2022] POST /identity/v3/users => generated 288 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:34.242728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278a8df-4844-47dc-b327-caa624241574 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.243021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278a8df-4844-47dc-b327-caa624241574 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.243792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278a8df-4844-47dc-b327-caa624241574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.262082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860a2c1e6c9d483bb205636ac8ebb7cc', 'request_id': 'req-309fa26e-28d7-436b-aa98-350a57d9a7d6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.281921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860a2c1e6c9d483bb205636ac8ebb7cc', 'request_id': 'req-309fa26e-28d7-436b-aa98-350a57d9a7d6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.311586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860a2c1e6c9d483bb205636ac8ebb7cc', 'request_id': 'req-309fa26e-28d7-436b-aa98-350a57d9a7d6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.335876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7278a8df-4844-47dc-b327-caa624241574 None None] MFA Rules not processed for user `fd2dd5289d3b4d229a7feeb4964e9962`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:34.338697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7278a8df-4844-47dc-b327-caa624241574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.342418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] The token cache is being invalidate because project 860a2c1e6c9d483bb205636ac8ebb7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:34.342717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.344435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.346969 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 907/1811] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:33 2022] DELETE /identity/v3/projects/860a2c1e6c9d483bb205636ac8ebb7cc => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:34.347785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.351595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.433360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:34.514039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa26e-28d7-436b-aa98-350a57d9a7d6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.520323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.521222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.522022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.522492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.523567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.525447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27205695-1c2c-4077-890d-14daa1c1ae39 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.540995 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 908/1812] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:34.542860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.543459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.543979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.565827 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 905/1813] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:34.566263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278a8df-4844-47dc-b327-caa624241574 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.567705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7278a8df-4844-47dc-b327-caa624241574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.572703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:34.574091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.605393 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 909/1814] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:34.606488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.613314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.640904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfef27-84ed-489b-9be4-50a1ff000fd9 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.649561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278a8df-4844-47dc-b327-caa624241574 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.653669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.654347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.654659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.655051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] PATH_INFO: `/v3/projects/6ce155167b064cc7a09a71c89ef661d7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.657312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce155167b064cc7a09a71c89ef661d7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.658292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df129646f6b8415f9782f861761974ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e4b0afe8184779b197492a5361371e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.659373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.659501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.659820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.660206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.661078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:34.661504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.663556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.691683 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 906/1815] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:34.693689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.725981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd6263-8157-48da-8dbd-828aeadb1eb7 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.741085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.741842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.742133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.742449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] PATH_INFO: `/v3/projects/7c2f08667f8d470d93b0771a1554da39/users/c225852c0f2a44b5b6d0dc866b988909/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.768392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2f08667f8d470d93b0771a1554da39, user_id=c225852c0f2a44b5b6d0dc866b988909, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.769972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce155167b064cc7a09a71c89ef661d7', 'request_id': 'req-d23b0b06-5d90-4c3f-9348-38609199c08c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.771494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.790952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce155167b064cc7a09a71c89ef661d7', 'request_id': 'req-d23b0b06-5d90-4c3f-9348-38609199c08c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.801654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce155167b064cc7a09a71c89ef661d7', 'request_id': 'req-d23b0b06-5d90-4c3f-9348-38609199c08c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.809622 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 907/1816] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:34 2022] PUT /identity/v3/projects/7c2f08667f8d470d93b0771a1554da39/users/c225852c0f2a44b5b6d0dc866b988909/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:34.809622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.810119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.825726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] The token cache is being invalidate because project 6ce155167b064cc7a09a71c89ef661d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:34.826212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.827195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d23b0b06-5d90-4c3f-9348-38609199c08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:34.831190 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 910/1817] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:34 2022] DELETE /identity/v3/projects/6ce155167b064cc7a09a71c89ef661d7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:34.832362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.832746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.833124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.880960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:34.885960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:34.889990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:34.915604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c113-1384-42ad-9a5c-e07eb84067f9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:34.927944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:34.928721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:34.929081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:34.929427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:34.930183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:34.932203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:34.990388 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 908/1818] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:34 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:34.990388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:34.995218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.053637 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 911/1819] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:35.054782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.064387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.092247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1d78-44df-4eaf-a04b-48877d8e508c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.104056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72d225-78fc-4828-8c2f-c8b8889f6df3 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.109451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df129646f6b8415f9782f861761974ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e4b0afe8184779b197492a5361371e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.110207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.110562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.110920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.112638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.118297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df1ee5-5de8-4af7-9d44-b97daff42ae8 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.192067 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 909/1820] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:34 2022] POST /identity/v3/projects => generated 353 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:35.192067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.192067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.192067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.244784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:35.246369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.253944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:35.329162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.329797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.330085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.330359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.331343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.333067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.385214 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 910/1821] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:35.385214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.385214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.394983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ee90c-9b48-429b-b5f0-cd54d3c3827a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.400625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.401271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.401601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.401886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.402637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.404978 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 912/1822] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:35.405203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.406500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.430301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577f51a-1183-4ed3-8e67-4d4381e939a8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.451181 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 911/1823] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:35 2022] POST /identity/v3/users => generated 294 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:35.451181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.455097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.456397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.456918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.457488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.459351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:35.461918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.464809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d902-3038-4572-a251-d0128de31910 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.511282 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 913/1824] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:35.515005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.516310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.516310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.536057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:35.547464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:35.548748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.575149 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 914/1825] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:35.576616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.587598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce719ca-03cc-46e9-a80a-50fade74884b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.590704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630952-e79e-476b-a68e-bb2e68105ff0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.593321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df129646f6b8415f9782f861761974ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e4b0afe8184779b197492a5361371e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.594507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.594800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.595155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.596022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:35.596400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.597194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.598404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.598734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.599136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] PATH_INFO: `/v3/projects/7c2f08667f8d470d93b0771a1554da39/users/c225852c0f2a44b5b6d0dc866b988909/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.599583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.603880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2f08667f8d470d93b0771a1554da39, user_id=c225852c0f2a44b5b6d0dc866b988909, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.607278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.621668 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 915/1826] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:35 2022] PUT /identity/v3/projects/7c2f08667f8d470d93b0771a1554da39/users/c225852c0f2a44b5b6d0dc866b988909/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:35.622654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.633702 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 912/1827] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:35.633702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.653882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d40d4-4855-4eee-80f9-7f1f96c708b1 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.726615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.727517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.727800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.728115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.729457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.731748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b2183-7f87-4170-962a-d098929c447e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.732550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b5f98-52af-45d5-89e3-1e40540c5518 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.738470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.739191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.739556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.739901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.740718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.742401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.757384 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 916/1828] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:35.758320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.770807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199127-a81a-484d-8f11-af03fe0d978a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.775976 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 913/1829] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:35 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:35.776714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.777078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.777435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.778972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.779596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.779880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.780184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.781482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:35.781872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.783472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.796020 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 917/1830] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:35.797477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.810213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] MFA Rules not processed for user `c225852c0f2a44b5b6d0dc866b988909`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:35.811457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:35.865621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557b952-764a-442b-afe7-23f5e6c2e16b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:35.891090 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 914/1831] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:35.892018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:35.898971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:35.927660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df129646f6b8415f9782f861761974ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96e4b0afe8184779b197492a5361371e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:35.928259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:35.928556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:35.928834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] PATH_INFO: `/v3/projects/17e146dc2e2e4b38aa5c1550393b2fa4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:35.930021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17e146dc2e2e4b38aa5c1550393b2fa4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:35.931968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:35.940122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:35.976184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8dbc-c62c-4453-a82e-6f41bb79dc95 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.004481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e146dc2e2e4b38aa5c1550393b2fa4', 'request_id': 'req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.013488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e146dc2e2e4b38aa5c1550393b2fa4', 'request_id': 'req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.022642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e146dc2e2e4b38aa5c1550393b2fa4', 'request_id': 'req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.044568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] The token cache is being invalidate because project 17e146dc2e2e4b38aa5c1550393b2fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:36.044876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.046170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.048861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 918/1832] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:35 2022] DELETE /identity/v3/projects/17e146dc2e2e4b38aa5c1550393b2fa4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:36.049672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.051006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.072038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.072815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.073171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.073519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] PATH_INFO: `/v3/projects/272861edb98f43dd9233a36ac7de88bb/users/139907a2d7bb49bca4af9fcaf760972c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.087648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca74c9-80f4-47b4-a43c-d9f8b768c763 tempest-VolumeQuotaClassesTest-1337687944 tempest-VolumeQuotaClassesTest-1337687944-project-admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.092644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.093272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.093686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.094037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.095372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.097711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.116948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272861edb98f43dd9233a36ac7de88bb, user_id=139907a2d7bb49bca4af9fcaf760972c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.119723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.131363 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 919/1833] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:36 2022] POST /identity/v3/users => generated 304 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:36.133302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.136135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.154649 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 915/1834] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:35 2022] PUT /identity/v3/projects/272861edb98f43dd9233a36ac7de88bb/users/139907a2d7bb49bca4af9fcaf760972c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:36.155697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cf534-9ab6-4c66-94c3-0ba65e503216 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.156417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.159782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.239210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3436d-67cf-47c6-919e-ac794e092db9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.243379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.244079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.244433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.244757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.246523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.249948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.250610 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.250895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.251172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.260380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.260380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.291915 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 920/1835] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:36 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:36.292771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.334146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:36.368683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.372301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.381263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab86aa-2d21-439e-9a8c-1135fbe8a139 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.387909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.388582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.389005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.389287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.390730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.392516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.402389 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 916/1836] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:36.404235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.407347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.407486 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 921/1837] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:36.408421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.419109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f82b20-a5f9-4a46-b178-8d41488a1751 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.424202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.424829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.425180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.428533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8a9ae-23a7-4a93-9882-418825a88676 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.433102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.433908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.435084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.435904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.437016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.437720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.452080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.456589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.461184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.487639 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 922/1838] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:36 2022] POST /identity/v3/users => generated 293 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:36.489006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.499746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.513985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0fd46-1fb8-4e42-8252-293537a5c957 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.525594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.526415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.526750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.527091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] PATH_INFO: `/v3/users/68a7cfed743f40d09a40526b537bd0ee` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.528375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a7cfed743f40d09a40526b537bd0ee)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.532645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.536221 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 917/1839] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:36.545684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.571477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:36.590336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67376-1490-4300-8c18-c85ab9c90acb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.604657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.605518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.605872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.606157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.608594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.612652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.616823 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a7cfed743f40d09a40526b537bd0ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.627100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a7cfed743f40d09a40526b537bd0ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.628285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a7cfed743f40d09a40526b537bd0ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.628948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a7cfed743f40d09a40526b537bd0ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.640136 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 918/1840] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:36.643195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.645147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a7cfed743f40d09a40526b537bd0ee'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:36.648546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.664521 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 923/1841] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:36 2022] DELETE /identity/v3/users/68a7cfed743f40d09a40526b537bd0ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:36.665374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.666772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.679562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bbb4d-0895-43c4-bb25-7e4eac0a3281 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.830496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ad22-01fb-4cf8-bdb0-f4f2943b924e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.840595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.841631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.842022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.842437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] PATH_INFO: `/v3/projects/272861edb98f43dd9233a36ac7de88bb/users/139907a2d7bb49bca4af9fcaf760972c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.845381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=272861edb98f43dd9233a36ac7de88bb, user_id=139907a2d7bb49bca4af9fcaf760972c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.849089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.850449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:36.851321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:36.851916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:36.852461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:36.853393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:36.855445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:36.870095 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 924/1842] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:36 2022] PUT /identity/v3/projects/272861edb98f43dd9233a36ac7de88bb/users/139907a2d7bb49bca4af9fcaf760972c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:36.871098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.884207 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 919/1843] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:36.884207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:36.884984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.887688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:36.901756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc0b89-35bc-499b-9d07-792af6c60fa3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:36.939467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:37.034103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.034609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b9bc4-61f1-4b9c-a53b-b1017853bf7e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.035382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.035755 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.036082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] PATH_INFO: `/v3/projects/5c0e570a4a134c72b3acdb5d93fdf315/users/d562396d402d491096f5fb4729bd38e0/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.044417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.045076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.049589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.049937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.054351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.066696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c0e570a4a134c72b3acdb5d93fdf315, user_id=d562396d402d491096f5fb4729bd38e0, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.069827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe33ea5-955c-4d42-955d-ce04a062ea32 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.103371 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 920/1844] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:36 2022] PUT /identity/v3/projects/5c0e570a4a134c72b3acdb5d93fdf315/users/d562396d402d491096f5fb4729bd38e0/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:37.105604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.105994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.106326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.141006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:37.142407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.175236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.177337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6948fbf-3e08-4294-a2a5-77c5f0476b83 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.192937 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 925/1845] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:37.194896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63762-b83d-479f-afed-df64a79c9c73 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.195572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63762-b83d-479f-afed-df64a79c9c73 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.196023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63762-b83d-479f-afed-df64a79c9c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.261621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f0a63762-b83d-479f-afed-df64a79c9c73 None None] MFA Rules not processed for user `139907a2d7bb49bca4af9fcaf760972c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:37.264029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f0a63762-b83d-479f-afed-df64a79c9c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.303731 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 921/1846] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:37.306867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.330000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd18a1-74c4-4c66-9664-f5483f263ebc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.345429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.348039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.348410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.348838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.349756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.352860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddefa8f-97ff-4c41-9ab5-35574fdd9ed5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.388619 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 922/1847] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:37.389708 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 926/1848] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:37.396440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.396440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.396910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.400058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.401472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.402604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.408764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:37.461244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] MFA Rules not processed for user `d562396d402d491096f5fb4729bd38e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:37.463224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.517304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:37.518919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.568142 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 923/1849] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:37.568142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.569588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.581798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:37.638992 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 927/1850] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:37.639926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882e2f-9181-4f72-8068-ca700cd6eeef None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.642592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.651456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.652270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.652636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.653469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.668806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503329b7-769f-44c8-8c33-b6d913096a77 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.671861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.673841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.685384 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 924/1851] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:37.686096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.687544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.692237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.694096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.694543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.695515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] PATH_INFO: `/v3/projects/6f7d811413ca492c8207c8e58a6ce24d/users/0b92605d183649d5870560c1c4f76e08/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.722217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7d811413ca492c8207c8e58a6ce24d, user_id=0b92605d183649d5870560c1c4f76e08, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.727344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.746447 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 928/1852] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:37 2022] PUT /identity/v3/projects/6f7d811413ca492c8207c8e58a6ce24d/users/0b92605d183649d5870560c1c4f76e08/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:37.747391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.773029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889574c9-5c0f-4bd1-9d76-e2df31104019 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.857649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.858399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.861638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.861987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.864777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.871179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:37.871914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ca52c-5f55-4ae4-ba66-5e4f727f8031 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:37.879970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:37.881080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.882025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.882313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.884273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.887172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e5d7-ea05-4784-b0ee-9a57384a12be admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.938047 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 929/1853] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:37.939784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:37.940329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:37.940824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:37.966537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:37.967464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:37.976501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] MFA Rules not processed for user `0b92605d183649d5870560c1c4f76e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:37.978144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:37.983445 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 925/1854] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:37.984765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:37.986269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:38.151790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8a9c9-46b5-429f-a6e8-3d865bdbabe1 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.203441 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 930/1855] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:38.204604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.226992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:38.291351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.292037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.292327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.292604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.330952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca248ce-a51a-4b00-bb7c-ba96eabe8140 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.346311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.347436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.348104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.348535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.349626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.354225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cc3d0-3de4-404d-90dc-bd4796d5152f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.364613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:38.414330 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 931/1856] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:38 2022] POST /identity/v3/users => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:38.417719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.417946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.420259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.449603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.451507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.469101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:38.474858 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 926/1857] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:18:38.477299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.482619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:38.500265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9951-dfef-4fc9-bca3-b71b5a0c6bfa service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.532853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.533507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.533793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.534079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.535086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.537231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.621296 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 927/1858] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:38 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:38.622339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.737361 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 932/1859] 10.222.0.58 () {58 vars in 1015 bytes} [Sun Jul 31 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:38.738869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.748804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:38.757223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fdb9-fd2e-4eda-ae8c-9dfb81767abd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.768436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.770903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.771191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.771471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.772447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.774067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.784766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d720c1-8d1a-4bb8-9d02-7aa42335accd None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.799200 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.801474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.801787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.802069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] PATH_INFO: `/v3/projects/8ef2efab238b44dc8b8a50b9516da13c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.802679 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 928/1860] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:38.803549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.804615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef2efab238b44dc8b8a50b9516da13c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.806959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.841114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35809-4eec-4bd2-8200-598e9bdcd1bb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:38.852371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:38.854550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:38.854845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:38.855125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:38.855803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:38.857771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:38.931601 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 929/1861] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:38 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:38.932645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:38.971626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef2efab238b44dc8b8a50b9516da13c', 'request_id': 'req-f4903d71-f4a4-42fd-9831-76f92dcefd4c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:38.986256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef2efab238b44dc8b8a50b9516da13c', 'request_id': 'req-f4903d71-f4a4-42fd-9831-76f92dcefd4c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:39.012209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef2efab238b44dc8b8a50b9516da13c', 'request_id': 'req-f4903d71-f4a4-42fd-9831-76f92dcefd4c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:39.036420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] The token cache is being invalidate because project 8ef2efab238b44dc8b8a50b9516da13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:39.036800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:39.039056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:39.041610 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 933/1862] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:38 2022] DELETE /identity/v3/projects/8ef2efab238b44dc8b8a50b9516da13c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:39.042517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.048910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:39.184031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fec907-be7b-4989-bebe-01d391846117 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.215407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:39.271889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4903d71-f4a4-42fd-9831-76f92dcefd4c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.289267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.290066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.290366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.290633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] PATH_INFO: `/v3/projects/94761968c0d54e6d82496d01170a69d6/users/35078f27852d4a58a88bb42f1ee0f621/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.319253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:39.348328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94761968c0d54e6d82496d01170a69d6, user_id=35078f27852d4a58a88bb42f1ee0f621, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.352160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.358286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.361733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.363381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.363854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.386565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:39.386669 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 934/1863] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:39 2022] PUT /identity/v3/projects/94761968c0d54e6d82496d01170a69d6/users/35078f27852d4a58a88bb42f1ee0f621/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:39.386669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.386669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:39.418283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.420202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.456779 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 930/1864] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:39.457855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.460637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:39.491805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcf68e-91a0-40af-894b-791d26558d46 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.543665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea2dd-f16d-4892-92a1-4e7017f6b8d4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.555357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.556109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.557313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.557313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.557577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.559368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.575103 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 935/1865] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:39.576037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.619977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14c9ba-44e7-4384-8a78-5d671f19cd5a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.633182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.634682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.635313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.635749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.636801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.638770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.677241 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 936/1866] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:39.678471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.693570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b40ba-1972-4f39-bbf3-d833d6948e4d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.699193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.699998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.700293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.700753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] PATH_INFO: `/v3/projects/f666af615d7746828f82df380c1645f5/users/bc670b0d97a148bf95e75533994f3467/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.742050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f666af615d7746828f82df380c1645f5, user_id=bc670b0d97a148bf95e75533994f3467, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.753391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.776576 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 937/1867] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:39 2022] PUT /identity/v3/projects/f666af615d7746828f82df380c1645f5/users/bc670b0d97a148bf95e75533994f3467/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:39.777291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:39.810231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.811563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.813429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.813948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] PATH_INFO: `/v3/users/df129646f6b8415f9782f861761974ea` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.816773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df129646f6b8415f9782f861761974ea)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.824401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:39.894011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65031f55-7b14-41a4-9b15-a77cbb43727b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:39.909291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:39.910110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:39.910401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:39.910735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] PATH_INFO: `/v3/projects/94761968c0d54e6d82496d01170a69d6/users/35078f27852d4a58a88bb42f1ee0f621/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:39.923675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94761968c0d54e6d82496d01170a69d6, user_id=35078f27852d4a58a88bb42f1ee0f621, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:39.962237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:40.006004 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 938/1868] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:39 2022] PUT /identity/v3/projects/94761968c0d54e6d82496d01170a69d6/users/35078f27852d4a58a88bb42f1ee0f621/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:40.007188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:40.012998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df129646f6b8415f9782f861761974ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:40.050666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df129646f6b8415f9782f861761974ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:40.052413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df129646f6b8415f9782f861761974ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:40.067642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:40.079697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df129646f6b8415f9782f861761974ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:40.118468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1949d04-e775-449c-8f5e-6f7ef04c9746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df129646f6b8415f9782f861761974ea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:40.152550 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 931/1869] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:39 2022] DELETE /identity/v3/users/df129646f6b8415f9782f861761974ea => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:40.158429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:40.158718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:40.158997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:40.166501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf711f0-1e2d-4277-af00-5ab4c7976fd4 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:40.242022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] MFA Rules not processed for user `35078f27852d4a58a88bb42f1ee0f621`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:40.246598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:40.314901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:40.315824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:40.316385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:40.317081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:40.318100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:40.322312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:40.386682 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 939/1870] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:40.390645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:40.406395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:40.410266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:40.454750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a66be-cc02-45f9-aab7-978c7e6902fd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:40.455467 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 932/1871] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:40.464507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:40.466297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:40.483255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:40.484294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:40.484622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:40.485024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] PATH_INFO: `/v3/projects/f666af615d7746828f82df380c1645f5/users/bc670b0d97a148bf95e75533994f3467/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:40.487792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f666af615d7746828f82df380c1645f5, user_id=bc670b0d97a148bf95e75533994f3467, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:40.491123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae7dbb-d7bf-4f88-8c2e-01d714de182f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:40.507469 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 940/1872] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:40 2022] PUT /identity/v3/projects/f666af615d7746828f82df380c1645f5/users/bc670b0d97a148bf95e75533994f3467/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:40.519756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:40.520113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:40.520569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:40.564513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] MFA Rules not processed for user `bc670b0d97a148bf95e75533994f3467`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:40.566184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:40.613343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf30284-15d5-4847-addf-118c9c340f05 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:40.731730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:40.732901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:40.733336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:40.734323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:40.833257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:40.837051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:40.870335 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 933/1873] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:40.891498 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 941/1874] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:40.979897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:40.995369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911eaa7-468a-49aa-bc53-a95471164d5c service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:41.008863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:41.010904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:41.015982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:41.015982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:41.068731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:41.075860 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:41.130807 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 934/1875] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:41.612969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:41.630883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7223c75-b0d8-4503-b774-e89847b5d400 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:41.634973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:41.635514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:41.635797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:41.636115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:41.643433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:41.715757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:41.787819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:41.789344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:41.814413 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 942/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:41.938486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:41.940081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:41.961278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f27e9b-4e85-49a5-8f01-752745b5d3ce service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:41.983129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:41.983129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:41.983129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:41.983601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:42.008798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:42.169568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:42.262683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428232f-5d82-41df-ab5f-8c5a6d14c524 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:42.284205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:42.287202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:42.287483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:42.288047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] PATH_INFO: `/v3/users/0b92605d183649d5870560c1c4f76e08` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:42.304095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b92605d183649d5870560c1c4f76e08)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:42.306309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:42.335573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:42.345881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352471b-1dcb-4f65-aac0-a79e8a4ab2e9 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:42.382503 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 943/1877] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:42.384443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace147-8251-438d-b5b0-448252ab9a4e None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:42.387686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace147-8251-438d-b5b0-448252ab9a4e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:42.388202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdace147-8251-438d-b5b0-448252ab9a4e None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:42.394119 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 944/1878] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:18:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:42.410889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:42.411171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:42.411497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:42.474854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b92605d183649d5870560c1c4f76e08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:42.477690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:42.479186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:42.495710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b92605d183649d5870560c1c4f76e08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:42.496368 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b92605d183649d5870560c1c4f76e08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:42.513450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b92605d183649d5870560c1c4f76e08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:42.556964 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-484bba9a-bc2d-4347-8ee3-b4ca117bcf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b92605d183649d5870560c1c4f76e08'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:42.574425 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 935/1879] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:41 2022] DELETE /identity/v3/users/0b92605d183649d5870560c1c4f76e08 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:18:42.585708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:42.594611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:42.595022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:42.658745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:42.661426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:42.688269 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 945/1880] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:42.851628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:42.854708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:42.895167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344043c5-437d-4328-b60a-e70d681da8b7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:42.897675 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 936/1881] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:42.906067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:42.908276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:43.059613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416860af-1de1-4cf9-8156-51be45bb35df None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:43.070976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:43.072304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.072887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.073503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.099803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:43.101696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee6579-4f0c-4f5f-b82f-fb29a09ddd7c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:43.125370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 937/1882] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:43.135328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:43.212359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:43.213162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.213723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.216563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.239313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:43.243389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac55615-fa9c-4387-9598-e7be2fcd6b7c service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:43.300266 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 946/1883] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:43.903527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.903957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.904380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.907317 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 938/1884] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:18:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:43.923034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a757b-f02b-4df6-b56f-605f0faea84c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:43.923329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a757b-f02b-4df6-b56f-605f0faea84c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:43.923740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a757b-f02b-4df6-b56f-605f0faea84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:43.940339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:43.942499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:43.971891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:43.994905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd291-c71c-4e7f-8a44-e3cc700a822e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:44.007716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:44.014124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.015969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.017021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] PATH_INFO: `/v3/projects/96e4b0afe8184779b197492a5361371e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.017766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d91a757b-f02b-4df6-b56f-605f0faea84c None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:44.019048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d91a757b-f02b-4df6-b56f-605f0faea84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:44.022201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e4b0afe8184779b197492a5361371e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:44.028769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:44.060598 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 947/1885] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:18:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:44.216971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e4b0afe8184779b197492a5361371e', 'request_id': 'req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.233605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e4b0afe8184779b197492a5361371e', 'request_id': 'req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.258267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e4b0afe8184779b197492a5361371e', 'request_id': 'req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.289848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] The token cache is being invalidate because project 96e4b0afe8184779b197492a5361371e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:44.293072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.294904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd2f3590-8abf-4f35-a164-ed9f7b3ee7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.306280 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 939/1886] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:43 2022] DELETE /identity/v3/projects/96e4b0afe8184779b197492a5361371e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:18:44.308369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.308894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.308976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.369752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:44.371055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:44.516983 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 948/1887] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:44.519496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.519890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.520304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.552265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:44.554235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:44.567890 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 940/1888] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:44.572434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:44.592673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffadf4f6-92a7-4873-8bdb-051fd223d3c6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:44.599562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:44.600379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.600891 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.601271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.602049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:44.602514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:44.604634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:44.627546 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 949/1889] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:44.632693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:44.648251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdd97-9770-463b-870c-80be49eeb90c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:44.661931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:44.664288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.664966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.666045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.667269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:44.670725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:44.721151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:44.724913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:44.778403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5cc2e-5b14-466d-959c-6e68659030bf admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:44.807238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:44.807238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:44.807238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:44.807238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] PATH_INFO: `/v3/projects/6f7d811413ca492c8207c8e58a6ce24d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:44.809852 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 941/1890] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:44 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:18:44.811358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7d811413ca492c8207c8e58a6ce24d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:44.817015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:44.823659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:44.962392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7d811413ca492c8207c8e58a6ce24d', 'request_id': 'req-97c58d43-c2cd-4eb5-aac5-300c99d573af'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.978815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7d811413ca492c8207c8e58a6ce24d', 'request_id': 'req-97c58d43-c2cd-4eb5-aac5-300c99d573af'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:44.993566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7d811413ca492c8207c8e58a6ce24d', 'request_id': 'req-97c58d43-c2cd-4eb5-aac5-300c99d573af'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.010288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e162ab-dbf2-4612-9618-0f6ddb6a9d0d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.048718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] The token cache is being invalidate because project 6f7d811413ca492c8207c8e58a6ce24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:45.049111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.050451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.064306 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 950/1891] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:44 2022] DELETE /identity/v3/projects/6f7d811413ca492c8207c8e58a6ce24d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:18:45.067593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.070067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.188325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.190050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.190277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.190626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.191427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.193314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.229149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:45.261404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:45.291408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c58d43-c2cd-4eb5-aac5-300c99d573af admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.309857 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 942/1892] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:44 2022] POST /identity/v3/users => generated 294 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:45.312924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.313841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.315113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.315281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.317035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.321294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.323409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.341551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.344436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.364156 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 951/1893] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:45.364156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.365515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.374774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be5245-ccce-4ea4-bb23-468af6d5e212 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.395064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308ac3f-9b07-464d-a4bb-58d16b1b605b service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.433822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.434323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.436547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.438314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.438568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.438866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.440659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.444641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] PATH_INFO: `/v3/users/bc670b0d97a148bf95e75533994f3467` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.446389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.454111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc670b0d97a148bf95e75533994f3467)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.458770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.469827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.511684 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 952/1894] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:45.515616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.557080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d698698-de58-44d3-968a-4aa1a448a500 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.583763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.584710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.589374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.589679 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.590440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.595532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.633701 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 953/1895] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:45.640143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.658655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926c20-b735-4b87-8c4c-ee8298a76df5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:45.674683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:45.675393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.675681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.676172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] PATH_INFO: `/v3/projects/cf6680ba6159440895028edb142312f9/users/a37a1ca90169481ea15adca03ce91c2a/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.710056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6680ba6159440895028edb142312f9, user_id=a37a1ca90169481ea15adca03ce91c2a, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:45.712797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111415-dec4-4bd9-b820-f64b95ca51cd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:45.715028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc670b0d97a148bf95e75533994f3467'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.745584 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 954/1896] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:45 2022] PUT /identity/v3/projects/cf6680ba6159440895028edb142312f9/users/a37a1ca90169481ea15adca03ce91c2a/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:45.755063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc670b0d97a148bf95e75533994f3467'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.755063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc670b0d97a148bf95e75533994f3467'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.756580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:45.756938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:45.757226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:45.776538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc670b0d97a148bf95e75533994f3467'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.833370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] MFA Rules not processed for user `a37a1ca90169481ea15adca03ce91c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:45.839578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:45.845698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc670b0d97a148bf95e75533994f3467'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:45.862431 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 943/1897] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:45 2022] DELETE /identity/v3/users/bc670b0d97a148bf95e75533994f3467 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:45.941193 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 955/1898] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:45.956782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:45.966789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:46.248545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae08e90-0d24-4caa-9e39-9e8b12973c45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.265214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:46.266602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:46.267283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:46.267723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:46.268978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:46.271565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:46.349441 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 944/1899] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:45 2022] POST /identity/v3/projects => generated 385 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:46.354132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:46.552606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e061377-e4b9-44da-b0ca-2f5e1a806544 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.605366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:46.715327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:46.717496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:46.718532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:46.721468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:46.726229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:46.728611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:46.761835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:46.765412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:46.786364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766498-a0f6-4c9f-bc3f-977098fafbff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.790067 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 956/1900] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:46 2022] POST /identity/v3/users => generated 293 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:46.794095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:46.802574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:46.803351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:46.803690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:46.804019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] PATH_INFO: `/v3/projects/f666af615d7746828f82df380c1645f5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:46.816847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f666af615d7746828f82df380c1645f5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:46.819475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:46.837465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3dea-e004-4927-8ad6-b2b3c9c74a51 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.850854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:46.851630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:46.851831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:46.852824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:46.853193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:46.856935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:46.885490 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 957/1901] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:46.889099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:46.905986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80d9ff-1b0a-42fc-8981-0ea23c03ce69 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.918136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:46.918877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:46.919263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:46.919640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:46.920522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:46.923613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:46.948065 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 958/1902] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:18:46.950172 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:46.951736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:46.952050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f666af615d7746828f82df380c1645f5', 'request_id': 'req-c73161b2-5ab7-4d41-a755-33c63f2626a1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:46.958284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:46.964443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f666af615d7746828f82df380c1645f5', 'request_id': 'req-c73161b2-5ab7-4d41-a755-33c63f2626a1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:46.977520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f666af615d7746828f82df380c1645f5', 'request_id': 'req-c73161b2-5ab7-4d41-a755-33c63f2626a1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:46.982691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09503a0-3c3b-4005-a1bf-fe14c81a64a6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:46.999300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] The token cache is being invalidate because project f666af615d7746828f82df380c1645f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:46.999806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.001165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.004608 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 945/1903] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:46 2022] DELETE /identity/v3/projects/f666af615d7746828f82df380c1645f5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:47.005887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:47.015204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.134072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:47.135871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.136422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.136890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] PATH_INFO: `/v3/users/fd2dd5289d3b4d229a7feeb4964e9962` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.139710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2dd5289d3b4d229a7feeb4964e9962)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:47.143764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:47.153832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73161b2-5ab7-4d41-a755-33c63f2626a1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:47.167211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:47.167919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.168322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.168785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] PATH_INFO: `/v3/projects/0a8b7c924bdb428e86c611ecf6b5e60f/users/d5fa62c6bbaf497e83847f2e6ff5466a/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.220534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8b7c924bdb428e86c611ecf6b5e60f, user_id=d5fa62c6bbaf497e83847f2e6ff5466a, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:47.223537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d1a08-bef5-4d70-a7ca-8b567c2e329e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:47.231668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2dd5289d3b4d229a7feeb4964e9962'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.261308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2dd5289d3b4d229a7feeb4964e9962'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.265450 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2dd5289d3b4d229a7feeb4964e9962'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.266773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2dd5289d3b4d229a7feeb4964e9962'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.268187 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 946/1904] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:47 2022] PUT /identity/v3/projects/0a8b7c924bdb428e86c611ecf6b5e60f/users/d5fa62c6bbaf497e83847f2e6ff5466a/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:47.269520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6bef-a24c-457a-952e-6d72efc767a2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.269811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6bef-a24c-457a-952e-6d72efc767a2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.270093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6bef-a24c-457a-952e-6d72efc767a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.320859 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0e6c0d8c-c8de-47f3-8699-a21df3a7e92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2dd5289d3b4d229a7feeb4964e9962'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.347975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ddfb6bef-a24c-457a-952e-6d72efc767a2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:47.360067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ddfb6bef-a24c-457a-952e-6d72efc767a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.389363 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 959/1905] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:46 2022] DELETE /identity/v3/users/fd2dd5289d3b4d229a7feeb4964e9962 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:47.393002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e709b-27a5-46e2-a326-6bc5021b7c7e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.398824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e709b-27a5-46e2-a326-6bc5021b7c7e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.399240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e709b-27a5-46e2-a326-6bc5021b7c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.508127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:47.533524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-287e709b-27a5-46e2-a326-6bc5021b7c7e None None] MFA Rules not processed for user `d5fa62c6bbaf497e83847f2e6ff5466a`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:47.535028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-287e709b-27a5-46e2-a326-6bc5021b7c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.609140 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 947/1906] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:47.610599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.610890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.611163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.638777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:47.643080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.706022 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 960/1907] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:47.706022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.706022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.706022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.729613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:47.747702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:47.749352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.750157 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 948/1908] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:47.751597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:47.755924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.762740 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 961/1909] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:47.762740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:47.762740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.778116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d2acc-bab0-444d-9fc8-6344c774b853 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:47.782729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e27d27-02bf-4d0a-b902-4624da13521a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:47.786724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:47.787913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.788634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.789230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.790783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:47.791569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:47.793048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:47.793180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:47.793668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:47.794099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] PATH_INFO: `/v3/users/dbdc259e7efd41eeb9452dada5c40991` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:47.796088 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdc259e7efd41eeb9452dada5c40991)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:47.798558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:47.868584 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 962/1910] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:47 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:47.869492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:47.871488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.903615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdc259e7efd41eeb9452dada5c40991'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.914993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdc259e7efd41eeb9452dada5c40991'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.916058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdc259e7efd41eeb9452dada5c40991'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.925216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdc259e7efd41eeb9452dada5c40991'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.941362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdc259e7efd41eeb9452dada5c40991'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:47.953364 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 949/1911] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:47 2022] DELETE /identity/v3/users/dbdc259e7efd41eeb9452dada5c40991 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:47.954745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:47.957357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:47.986571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7190521-81d7-4e7c-9bfb-dc851ea78cc2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.052080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988cc2c-0ccc-45ef-bfb2-12955024938c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.065145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.065625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.065911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.066345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.067310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:48.067626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.069556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.079659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.080334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.080874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.081148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.083334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:48.103343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.103570 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 950/1912] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:48.106074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29668862-7618-473e-a414-07d8632cc43a service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.108374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.110970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:48.127080 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 963/1913] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:48.128469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.128765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.129046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.154993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430642d-c4da-47ae-93ef-d2e396658b02 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.157525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.158457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.158587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.158837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.159525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.161199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:48.161576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.162664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:48.172463 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 964/1914] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:48.173809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.188322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ac28a-2040-43db-b94c-d98cef187147 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.194765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.195827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.196350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.196913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.197808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.200300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.221213 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 951/1915] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:48.222153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.225467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:48.237473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:48.242484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb18680-6c90-42a2-970c-590c87f41d58 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.248101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.252436 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 965/1916] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:48.252436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.257784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.258305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.259319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.272800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.274331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.295353 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 952/1917] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:48.296601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.310307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115d07d-a82b-470a-91e6-e9c0178e6d95 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.378258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:48.425883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420a60e-8c89-443b-af77-1a5f699fdb1c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.440079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.442258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.443684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.444214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.445151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.448219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.448612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.449073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.449249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.449868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.451858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.455989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.482983 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 966/1918] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:48.489935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.513360 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 953/1919] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:48.516634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.517580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e011ed2-d3ec-4542-830c-7f2d61c347f6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.537128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.537877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.538248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.538559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] PATH_INFO: `/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9/users/fb450a407e7544a2af78535f340466ca/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.547069 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694df3c5-adb4-4ad0-ad0a-0fbf5d2bb7cd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.570877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.572465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.574017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac1672e0ddd4e2f8700c36f7752d6f9, user_id=fb450a407e7544a2af78535f340466ca, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.574146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.576156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.577370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.578058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.588283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.607322 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 967/1920] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:48 2022] PUT /identity/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9/users/fb450a407e7544a2af78535f340466ca/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:48.612417 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.623554 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 954/1921] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:48.629852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.658266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980707a-b76c-4601-a895-5b7c07e34137 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.720863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aae83-f38f-421f-a8e5-b5aaa9d83454 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.727883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.729136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.729626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.730019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.730888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.732928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.752560 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 968/1922] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:48.753884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.755426 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.756282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.756608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.759342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.765228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.772586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.791309 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 955/1923] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:48.792639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:48.806973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ce96a-b91f-4b2e-9a97-1dddbf2e50b4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.810854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad512b6-a53a-4b95-8f33-3462fc6812cd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:48.820808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.822646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.822945 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.823367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] PATH_INFO: `/v3/projects/cf59f5f3240f4960a7c1b8630d4c357d/users/049ffd0a3afe477f8cb3e3715bdd8d42/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.825307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:48.829122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.829435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.829662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] PATH_INFO: `/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9/users/fb450a407e7544a2af78535f340466ca/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.835332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac1672e0ddd4e2f8700c36f7752d6f9, user_id=fb450a407e7544a2af78535f340466ca, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.842676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a050-7806-49eb-84ca-91fa2b891be6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.845758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf59f5f3240f4960a7c1b8630d4c357d, user_id=049ffd0a3afe477f8cb3e3715bdd8d42, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:48.848580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554132ad-2f35-4814-9707-d1bdd1f12e2d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:48.887096 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 969/1924] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:48 2022] PUT /identity/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9/users/fb450a407e7544a2af78535f340466ca/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:48.898440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.898968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.899306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.907761 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 956/1925] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:48 2022] PUT /identity/v3/projects/cf59f5f3240f4960a7c1b8630d4c357d/users/049ffd0a3afe477f8cb3e3715bdd8d42/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:48.910661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:48.910953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:48.911288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:48.966818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] MFA Rules not processed for user `fb450a407e7544a2af78535f340466ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:48.970922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.034206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] MFA Rules not processed for user `049ffd0a3afe477f8cb3e3715bdd8d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:49.037371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.064914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:49.118098 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 970/1926] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:49.119242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.120761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.184402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 957/1927] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:49.185714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.187764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.216673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:49.276794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded5466-054d-448b-adc7-4ccbf42e09d4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.282883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a965854-4d95-4e31-85f9-2e12820fb5c2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.289786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.292351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.293032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.293362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.293508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.294732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.295092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.295548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] PATH_INFO: `/v3/projects/75ab4feb8f174175bce4a667fe816cc4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.307252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ab4feb8f174175bce4a667fe816cc4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.310490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.310929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.314831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.331438 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 958/1928] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:49.332787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.349188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4eae87-e17c-4875-a2b8-eb18eda907bb service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.357297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.359560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.359985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.360520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.361512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.364874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.456173 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 959/1929] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:49 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:49.460155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.494833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ab4feb8f174175bce4a667fe816cc4', 'request_id': 'req-4c6da28e-0356-47a9-b529-88e1d0b841c8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.521491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ab4feb8f174175bce4a667fe816cc4', 'request_id': 'req-4c6da28e-0356-47a9-b529-88e1d0b841c8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.541340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ab4feb8f174175bce4a667fe816cc4', 'request_id': 'req-4c6da28e-0356-47a9-b529-88e1d0b841c8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.588209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] The token cache is being invalidate because project 75ab4feb8f174175bce4a667fe816cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:49.588533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.590289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.592327 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 971/1930] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:49 2022] DELETE /identity/v3/projects/75ab4feb8f174175bce4a667fe816cc4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:49.595105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.621740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.725855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edef41-75aa-4ccf-91b5-f09bfe6e91ed admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.738622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.739784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.740133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.740416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.741132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.745995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.784321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6da28e-0356-47a9-b529-88e1d0b841c8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.808389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.809078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.810265 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 960/1931] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:49 2022] POST /identity/v3/users => generated 303 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:49.814300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:49.814856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.815289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] PATH_INFO: `/v3/projects/4c716455d8434aaf9244fc4f715263f4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.816187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:49.816672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c716455d8434aaf9244fc4f715263f4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.818720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.853851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8201da-4be5-4e5f-86ff-3982a11e180c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:49.864514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:49.875717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:49.877978 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:49.878957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:49.879257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] PATH_INFO: `/v3/users/139907a2d7bb49bca4af9fcaf760972c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:49.883970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139907a2d7bb49bca4af9fcaf760972c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:49.896882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:49.980906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c716455d8434aaf9244fc4f715263f4', 'request_id': 'req-ba7b213e-5339-41d9-a6e1-d0b5c94be139'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:49.995026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c716455d8434aaf9244fc4f715263f4', 'request_id': 'req-ba7b213e-5339-41d9-a6e1-d0b5c94be139'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.008212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139907a2d7bb49bca4af9fcaf760972c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.013765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c716455d8434aaf9244fc4f715263f4', 'request_id': 'req-ba7b213e-5339-41d9-a6e1-d0b5c94be139'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.038511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139907a2d7bb49bca4af9fcaf760972c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.040063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139907a2d7bb49bca4af9fcaf760972c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.059196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] The token cache is being invalidate because project 4c716455d8434aaf9244fc4f715263f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:50.059635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.061019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.066845 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 972/1932] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:49 2022] DELETE /identity/v3/projects/4c716455d8434aaf9244fc4f715263f4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:50.068083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.072731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.073780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139907a2d7bb49bca4af9fcaf760972c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.127252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139907a2d7bb49bca4af9fcaf760972c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.133887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:50.152043 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 961/1933] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:49 2022] DELETE /identity/v3/users/139907a2d7bb49bca4af9fcaf760972c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:50.154399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.156926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.219271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b213e-5339-41d9-a6e1-d0b5c94be139 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.285334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1f817-a95e-4f3f-8ceb-1ca1522503e6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.295793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.297400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.297753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.298134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] PATH_INFO: `/v3/users/d562396d402d491096f5fb4729bd38e0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.299688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d562396d402d491096f5fb4729bd38e0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:50.301827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:50.363297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.364820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.366978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.367550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.369465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:50.375922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:50.400521 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 973/1934] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:50.402360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.407203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.423250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1ce5c-160a-45b8-b031-a6c6d4797aa8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.444426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.444746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd562396d402d491096f5fb4729bd38e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.445498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.446236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.446589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] PATH_INFO: `/v3/users/c225852c0f2a44b5b6d0dc866b988909` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.448487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c225852c0f2a44b5b6d0dc866b988909)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:50.451007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:50.471866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd562396d402d491096f5fb4729bd38e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.472892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd562396d402d491096f5fb4729bd38e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.487222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd562396d402d491096f5fb4729bd38e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.520310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd562396d402d491096f5fb4729bd38e0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.550665 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 962/1935] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:50 2022] DELETE /identity/v3/users/d562396d402d491096f5fb4729bd38e0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:50.552235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.557482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.566198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:50.585323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c225852c0f2a44b5b6d0dc866b988909'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.600263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c225852c0f2a44b5b6d0dc866b988909'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.601119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c225852c0f2a44b5b6d0dc866b988909'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.601920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c225852c0f2a44b5b6d0dc866b988909'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.621634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c805591e-aa42-4a1c-9421-63447b734f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c225852c0f2a44b5b6d0dc866b988909'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:50.646454 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 974/1936] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:50 2022] DELETE /identity/v3/users/c225852c0f2a44b5b6d0dc866b988909 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:50.651601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.653579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.654986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.694389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:50.695866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.698664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea391e0f-9210-4d4e-b670-1814e3f60c89 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.729702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:50.776817 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 975/1937] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:50.777786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.779159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.812268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.820010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.821748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.822103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] PATH_INFO: `/v3/projects/aecedafdf42149058eb4eb65d088e88d/users/9e2e97cc5ac1446884ae67b691beedc6/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.857050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecedafdf42149058eb4eb65d088e88d, user_id=9e2e97cc5ac1446884ae67b691beedc6, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:50.862529 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:50.878236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd7a95-164a-45ee-97f1-3d88af868702 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.884076 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 963/1938] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:50 2022] PUT /identity/v3/projects/aecedafdf42149058eb4eb65d088e88d/users/9e2e97cc5ac1446884ae67b691beedc6/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:50.885162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:50.888044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.974751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.975379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.975658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.975948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:50.977837 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:50.982191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d6a96-4b20-42c7-ac8d-34e4e56139fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:50.991995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:50.992824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:50.993311 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:50.993734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.014063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:51.056675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.058403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.069616 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 976/1939] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:51.070479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.071983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.087541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.091586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.105124 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 964/1940] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:51.106168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.107654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.124496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798c9f-7333-4007-97fb-5dfa55ed8d2e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.132287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.133289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.133629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.133908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.134803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.136913 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.150774 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 965/1941] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:51.155360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.163424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.165116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4774d1-d74b-4b9f-bb90-7c2a13d535c0 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.171408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.172243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.172631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.173012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] PATH_INFO: `/v3/projects/272861edb98f43dd9233a36ac7de88bb` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.174486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272861edb98f43dd9233a36ac7de88bb)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.176844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.213631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca46811-042e-4c50-80e9-f6f52bd87fb2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.221832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.222665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.223508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.223889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] PATH_INFO: `/v3/projects/7c2f08667f8d470d93b0771a1554da39` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.226287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2f08667f8d470d93b0771a1554da39)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.229014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.251626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272861edb98f43dd9233a36ac7de88bb', 'request_id': 'req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.260307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272861edb98f43dd9233a36ac7de88bb', 'request_id': 'req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.271051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272861edb98f43dd9233a36ac7de88bb', 'request_id': 'req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.291194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] The token cache is being invalidate because project 272861edb98f43dd9233a36ac7de88bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:51.291546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.292569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.297827 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 977/1942] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:51 2022] DELETE /identity/v3/projects/272861edb98f43dd9233a36ac7de88bb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:51.297827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.299547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.309958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:51.324836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2f08667f8d470d93b0771a1554da39', 'request_id': 'req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.337170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2f08667f8d470d93b0771a1554da39', 'request_id': 'req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.350645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2f08667f8d470d93b0771a1554da39', 'request_id': 'req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.368388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] The token cache is being invalidate because project 7c2f08667f8d470d93b0771a1554da39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:51.368780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.369470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e8d2fd59-5e79-4fcf-a82c-03abbc01649c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.374805 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 966/1943] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:51 2022] DELETE /identity/v3/projects/7c2f08667f8d470d93b0771a1554da39 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:51.376432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42bb6-3fae-431d-9100-7855f26cdcfb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.376868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42bb6-3fae-431d-9100-7855f26cdcfb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.377158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e42bb6-3fae-431d-9100-7855f26cdcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.402573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f8e42bb6-3fae-431d-9100-7855f26cdcfb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.403614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8e42bb6-3fae-431d-9100-7855f26cdcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.404000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:51.411791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad3c5f-c29d-4445-b1ab-9f1cf85c7ee2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.516639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.518613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.519017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.519568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] PATH_INFO: `/v3/projects/aecedafdf42149058eb4eb65d088e88d/users/9e2e97cc5ac1446884ae67b691beedc6/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.521762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecedafdf42149058eb4eb65d088e88d, user_id=9e2e97cc5ac1446884ae67b691beedc6, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.524624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.533936 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 967/1944] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:51.535958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a079a-12b6-4eb4-9558-e25245af939d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.536415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a079a-12b6-4eb4-9558-e25245af939d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.536745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a079a-12b6-4eb4-9558-e25245af939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.540073 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 978/1945] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:51 2022] PUT /identity/v3/projects/aecedafdf42149058eb4eb65d088e88d/users/9e2e97cc5ac1446884ae67b691beedc6/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:51.540073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.541522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.563803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ad9a079a-12b6-4eb4-9558-e25245af939d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.565193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad9a079a-12b6-4eb4-9558-e25245af939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.638878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e3ee9-e8d7-4293-aa0d-556427e01e5f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.645388 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 968/1946] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:51.646414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.647187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.647871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.648151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] PATH_INFO: `/v3/projects/5c0e570a4a134c72b3acdb5d93fdf315` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.649386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c0e570a4a134c72b3acdb5d93fdf315)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.651509 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.652961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6fac3-6010-41b2-89dd-79cafaca2756 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.653393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6fac3-6010-41b2-89dd-79cafaca2756 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.653526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6fac3-6010-41b2-89dd-79cafaca2756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.674298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a0c6fac3-6010-41b2-89dd-79cafaca2756 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.675543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0c6fac3-6010-41b2-89dd-79cafaca2756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.684893 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 969/1947] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:51.688123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.688123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.688123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.706988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c0e570a4a134c72b3acdb5d93fdf315', 'request_id': 'req-93744406-1241-49e2-8912-22c023ce3339'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.714042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c0e570a4a134c72b3acdb5d93fdf315', 'request_id': 'req-93744406-1241-49e2-8912-22c023ce3339'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.715668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] MFA Rules not processed for user `9e2e97cc5ac1446884ae67b691beedc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.716953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.720186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c0e570a4a134c72b3acdb5d93fdf315', 'request_id': 'req-93744406-1241-49e2-8912-22c023ce3339'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.734176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] The token cache is being invalidate because project 5c0e570a4a134c72b3acdb5d93fdf315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:51.734606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.735337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-93744406-1241-49e2-8912-22c023ce3339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.737150 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 979/1948] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:51 2022] DELETE /identity/v3/projects/5c0e570a4a134c72b3acdb5d93fdf315 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:51.741812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.742097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.742386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.765965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:51.767190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.773763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:51.792597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:51.795087 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 970/1949] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:51.796053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.799779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.846992 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 980/1950] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:51.846992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.848808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.861129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb70b32-5c7b-48d5-aafc-78624ea02fe0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.870022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.870673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.870960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.871239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] PATH_INFO: `/v3/users/35078f27852d4a58a88bb42f1ee0f621` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.873434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35078f27852d4a58a88bb42f1ee0f621)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.876189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.876419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05f26-29e7-4de3-8970-c2673982f767 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.881550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.883010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.883010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.883010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.883746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:51.884181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:51.885875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:51.899345 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 971/1951] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:51.899345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.904295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.935022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35078f27852d4a58a88bb42f1ee0f621'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.944409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35078f27852d4a58a88bb42f1ee0f621'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.945172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35078f27852d4a58a88bb42f1ee0f621'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.946330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35078f27852d4a58a88bb42f1ee0f621'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.961736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35078f27852d4a58a88bb42f1ee0f621'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:51.978035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba5a0-dd9f-48a5-8107-8f5437407f8c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:51.985611 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 981/1952] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:51 2022] DELETE /identity/v3/users/35078f27852d4a58a88bb42f1ee0f621 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:51.986582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:51.988159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:51.991346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:51.991959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:51.992245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:51.992524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:51.997010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.013583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.015451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.035034 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 972/1953] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:52.036717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.038494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.056211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155fb2-250d-4d9f-b811-3b0af08e04e7 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.065577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.067500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.067961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.068359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.068467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7da86-ba3c-45af-ba46-03b9aa4c50b3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.069234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.071970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.074252 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.076094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.076487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.077104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.077570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:52.077895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.079802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.100697 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 982/1954] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:52.102034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.118351 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 973/1955] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:52.119337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.123327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.129083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888acc5-a89c-4231-af0d-ab9c0f7c2d4a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.173314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:52.218390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.219197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.220118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.220118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.220470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.223023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.234582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4375f0-f965-4c0f-bc6b-f1ae12c3b1b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.238450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.239083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.239370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.239650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.241822 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.261591 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 983/1956] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:18:52.262436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.265656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:52.317697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.319146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.329606 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 974/1957] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:52.330320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.338152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67bec-9839-4d48-a90b-cb10ddd445c2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.344682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.345567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.345979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.346637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.347518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.350568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.352958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe34e7c-4c3d-4f78-8613-a73476bee1ee service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.358275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.359483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.359870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.360361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.361179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.363447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.385502 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 984/1958] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:52.386909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.394287 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 975/1959] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:52.398953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.400697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb42b-5eed-435f-bf87-1aeb26f3d38e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.406453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.407081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.407373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.408166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.408385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.410735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.427370 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 985/1960] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:52.428466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.435209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec20e8-2f95-46a4-a542-bdbff95f8eb4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.440895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1539-0e14-4bda-8cf1-dda5d58b18f1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.446499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.447504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.447798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.448118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.449375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.450718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.451628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.455062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.455355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.456124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.456918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.460203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.476671 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 986/1961] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:52.477619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.480591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.495629 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 976/1962] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:52.496611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.496855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae414-a704-4a7b-b798-73e0a7559388 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.501923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.502581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.503025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.503318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] PATH_INFO: `/v3/projects/94761968c0d54e6d82496d01170a69d6` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.504571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94761968c0d54e6d82496d01170a69d6)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.506499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.515834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b755471-c83b-46ec-b7b3-3280ef4aa465 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.521401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.522085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.522373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.522650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] PATH_INFO: `/v3/projects/7caaab24c78e4beabf37b2bface19680/users/70f5f62cc219459c9ed63a66c526cef5/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.543572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7caaab24c78e4beabf37b2bface19680, user_id=70f5f62cc219459c9ed63a66c526cef5, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.547219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.568010 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 977/1963] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:52 2022] PUT /identity/v3/projects/7caaab24c78e4beabf37b2bface19680/users/70f5f62cc219459c9ed63a66c526cef5/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:52.569713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.582661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94761968c0d54e6d82496d01170a69d6', 'request_id': 'req-11650834-6025-45f0-9574-c63d65e3bfc8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:52.598352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94761968c0d54e6d82496d01170a69d6', 'request_id': 'req-11650834-6025-45f0-9574-c63d65e3bfc8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:52.620496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94761968c0d54e6d82496d01170a69d6', 'request_id': 'req-11650834-6025-45f0-9574-c63d65e3bfc8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:52.639841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] The token cache is being invalidate because project 94761968c0d54e6d82496d01170a69d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:52.640908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:52.641777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-11650834-6025-45f0-9574-c63d65e3bfc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:52.643407 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 987/1964] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:52 2022] DELETE /identity/v3/projects/94761968c0d54e6d82496d01170a69d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:52.648902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e7fb-e9d6-480c-962f-e74baf02c4f5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.649185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e7fb-e9d6-480c-962f-e74baf02c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.649464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823e7fb-e9d6-480c-962f-e74baf02c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.677703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:52.678139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f07b-e247-41c2-a63d-1884debcd489 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.687295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.687882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9823e7fb-e9d6-480c-962f-e74baf02c4f5 None None] MFA Rules not processed for user `70f5f62cc219459c9ed63a66c526cef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:52.688489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.689017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.689377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.690199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9823e7fb-e9d6-480c-962f-e74baf02c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.690386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.692956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d76fe-737c-4b12-9eaa-b6436b9467b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.736195 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 978/1965] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:52.742762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.743176 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.743341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.778436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:52.779824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.795386 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 979/1966] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:52.795386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.795386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.806857 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc2961-1ad7-4b9c-85b0-405043d6c61b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.820376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.821261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.821753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.822209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] PATH_INFO: `/v3/projects/0183f7966b614609b36afc54a1ee0b37/users/6d5528194cf84ead93354c532b2353de/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.827571 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 988/1967] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:52.829243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.829541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.829833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.852737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:52.853899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0183f7966b614609b36afc54a1ee0b37, user_id=6d5528194cf84ead93354c532b2353de, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.854048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.861217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.863484 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 989/1968] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:52.864467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.865790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:52.879657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb443ce-102c-40f8-a261-3667889d17b4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.886545 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 980/1969] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:52 2022] PUT /identity/v3/projects/0183f7966b614609b36afc54a1ee0b37/users/6d5528194cf84ead93354c532b2353de/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:52.888162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:52.942938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:52.970919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.971839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.972246 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.972746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.973639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.975661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebc6ff-8713-451d-9afd-24e6589e7328 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:52.986051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35344f5a-b7f0-4b6f-8005-71f235fd960f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:52.992087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:52.992716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:52.993307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:52.993307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:52.994062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:52.994273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:52.996116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.012797 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 990/1970] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:52 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:53.012797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.012797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.012797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.014077 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 981/1971] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:53.015276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.028037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b815f0-3c44-47b6-9c68-5f706dc99611 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.043484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] MFA Rules not processed for user `6d5528194cf84ead93354c532b2353de`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:53.044753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:53.098714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.099469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.099883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.100284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.101035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.103121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.123518 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 991/1972] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:53.124477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.130655 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 982/1973] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:53.131673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.142179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eadd9d-a2bb-462b-9a21-43ab3546e80b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.142969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a583-11df-4715-86de-449e4fc30fbb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.147760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.148170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.148607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.148777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.148893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.149061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.149173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.149357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.149840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.149996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.151756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.153007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.160935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:53.186848 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 983/1974] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:53.186978 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 992/1975] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:53.187807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.191119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.261191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7a22b-3a74-4d94-b400-0aea5e040597 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.262945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8819b-2c45-4917-a056-c601ea725328 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.266722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.267387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.267672 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.268039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.268562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.268772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.269186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.269471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.269747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.270319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.270751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.273275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.281372 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 984/1976] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.282264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.295082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb908ad8-f982-46f4-8a02-ab4d062110e6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.302397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.303333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.303690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.304135 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.304928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.305389 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 993/1977] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:18:53.307425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.308936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.321799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694cf0-41d9-433a-b625-250c8b7b39c9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.328376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.329104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.329386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.329695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] PATH_INFO: `/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.335194 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 985/1978] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/users => generated 291 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:53.336660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.348558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e07ea82fd74ec68d9c76adbcdeaab3, user_id=a67b6b5a77ab4ca4b5d3790f9a9ac626, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.349892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779ff94-6084-4347-bfb1-06ca17cb33a6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.351659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.355253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.356075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.356442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.356726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.357476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.359767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.365983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:53.368330 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 994/1979] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:53 2022] PUT /identity/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.372064 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.377297 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 986/1980] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.378378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.392184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177481c6-d8e5-46de-8534-0b91df65eef6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.450123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094b3a4-7d65-446e-bf0f-117925ab5907 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.455815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.456473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.456758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.457035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.457727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.459387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.463873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.465009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.465009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.465287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.466044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.468408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.470160 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 995/1981] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.473857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.481596 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 987/1982] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.481596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.488822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71654774-6fdd-47e7-b471-a8b88c6b51d6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.490092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02faa32-4226-429e-b33b-e86b47f723f8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.493921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.494591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.494964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.495240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] PATH_INFO: `/v3/projects/2130835d2b1241068b8e228002fbf70b/users/dda8e0c4268345b1af1b093a3a979fb7/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.495540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.496300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.496644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.496990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.497838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.499710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.510950 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 988/1983] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.511575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.518267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2130835d2b1241068b8e228002fbf70b, user_id=dda8e0c4268345b1af1b093a3a979fb7, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.520979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.524175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae048a-b716-428c-a394-723568064a0d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.529550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.530988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.531456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.531745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] PATH_INFO: `/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.533768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e07ea82fd74ec68d9c76adbcdeaab3, user_id=a67b6b5a77ab4ca4b5d3790f9a9ac626, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.536866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.543047 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 996/1984] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:53 2022] PUT /identity/v3/projects/2130835d2b1241068b8e228002fbf70b/users/dda8e0c4268345b1af1b093a3a979fb7/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.544141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.553506 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 989/1985] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:53 2022] PUT /identity/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.554442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.578131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:53.621001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f627e-9a41-4748-89ca-936eec0e4e0a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.634862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b583-e812-459a-a928-906078d29a09 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.641531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.642177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.642465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.642742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.643447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.645127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d8381-ea92-484a-aeab-832df929ee8d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.662862 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 990/1986] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:53.662862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070af16-4cf9-4259-a5cf-f5398b922ad3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.663395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070af16-4cf9-4259-a5cf-f5398b922ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.663503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070af16-4cf9-4259-a5cf-f5398b922ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.685275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.685956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.686393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.686865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] PATH_INFO: `/v3/projects/c3740a90e833482eb73f43c592d57f86/users/a063616e6da747fba3e8bcff2930328d/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.693413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2070af16-4cf9-4259-a5cf-f5398b922ad3 None None] MFA Rules not processed for user `a67b6b5a77ab4ca4b5d3790f9a9ac626`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:53.694647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2070af16-4cf9-4259-a5cf-f5398b922ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:53.703385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3740a90e833482eb73f43c592d57f86, user_id=a063616e6da747fba3e8bcff2930328d, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.706306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.721008 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 997/1987] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:53 2022] PUT /identity/v3/projects/c3740a90e833482eb73f43c592d57f86/users/a063616e6da747fba3e8bcff2930328d/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.722333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.756750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:53.768437 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 991/1988] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:53.769792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603585-156a-484b-abe8-247dfad5e88d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.770147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603585-156a-484b-abe8-247dfad5e88d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.770505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603585-156a-484b-abe8-247dfad5e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.790765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26650575-6fd3-48d1-97c9-828ef25361ec admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.795448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.796651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.796934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.797209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] PATH_INFO: `/v3/projects/2130835d2b1241068b8e228002fbf70b/users/dda8e0c4268345b1af1b093a3a979fb7/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.799196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2130835d2b1241068b8e228002fbf70b, user_id=dda8e0c4268345b1af1b093a3a979fb7, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.801860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.805323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-87603585-156a-484b-abe8-247dfad5e88d None None] MFA Rules not processed for user `a063616e6da747fba3e8bcff2930328d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:53.806520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-87603585-156a-484b-abe8-247dfad5e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:53.813155 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 998/1989] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:53 2022] PUT /identity/v3/projects/2130835d2b1241068b8e228002fbf70b/users/dda8e0c4268345b1af1b093a3a979fb7/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:53.814037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:53.824340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:53.884857 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 992/1990] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:53.886553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.886992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.887431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.894048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:53.898860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed8b22-05da-4f34-bb31-85f167a47e54 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:53.904026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:53.904866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:53.905313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:53.905930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:53.919248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] MFA Rules not processed for user `dda8e0c4268345b1af1b093a3a979fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:53.920624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:53.977959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:53.979436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:53.992608 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 999/1991] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:53.993838 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.009472 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 993/1992] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:54.069531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.077481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32d10-276d-463a-b40a-8a69b9adfa41 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.081017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417849a-88f6-4846-8efc-5c2939bbd873 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.082847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.083473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.083759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.084059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.084734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.086630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.090998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.091870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.093129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.093531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.104250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.105787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.117605 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 994/1993] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:54.118700 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1000/1994] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:53 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:54.122531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.141477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7e2c-b726-4324-87de-4df7d115fbe6 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.208237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.210820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:54.224950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:54.236601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.237701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.237988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.238262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.238958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.243436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.273349 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 995/1995] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:54 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:54.277392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.289567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8654d-db8b-4a65-81d8-2718073ba1b0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.290453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a037a35-bb24-4405-8150-1033292578b2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.294832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.294939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.295388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.295518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.295717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.296074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.296181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.296873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.297007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.298465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.309523 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 996/1996] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:54.314145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.325527 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bb48e-a1b8-40af-a1ac-71964e8694a7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.331561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.332319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.332839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.333228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] PATH_INFO: `/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4/users/13f377a69b13469ca209769e6fb7771a/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.358592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:54.362257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d841fd8bffeb4c73ab197c83fbc9a5b4, user_id=13f377a69b13469ca209769e6fb7771a, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.369307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.389007 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 997/1997] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:54 2022] PUT /identity/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4/users/13f377a69b13469ca209769e6fb7771a/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:54.392938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.393634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.394423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.405621 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1001/1998] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:54.486359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e94a9-cef6-4b23-b24e-67e25820c696 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.492216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.493303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.493684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.494119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.494992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.496824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864fc8d-f1fd-4edb-8a75-33cd3890f38c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.522867 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 998/1999] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:18:54.526541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.542370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06940a-45b0-44dc-8092-b5f09dbe6d82 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.555638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.555841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.556092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.556376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] PATH_INFO: `/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4/users/13f377a69b13469ca209769e6fb7771a/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.560560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d841fd8bffeb4c73ab197c83fbc9a5b4, user_id=13f377a69b13469ca209769e6fb7771a, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.566997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.590203 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1002/2000] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:54 2022] PUT /identity/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4/users/13f377a69b13469ca209769e6fb7771a/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:54.602751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.603117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.603477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.648902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] MFA Rules not processed for user `13f377a69b13469ca209769e6fb7771a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:54.657496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:54.783512 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 999/2001] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:54.864799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.931176 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:54.937333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0d41-0538-4121-b491-7d7cab5d3b24 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.942694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0bb5-e886-4d22-bb2a-5038f2edd2ec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:54.942811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.943361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.943652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.943953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.946685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:54.947360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:54.947668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:54.947921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:54.955402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:54.957500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:54.968458 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1003/2002] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:54.980866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:55.010357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:55.011976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:55.024550 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1000/2003] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:55.224736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:55.233899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0281f-154e-46af-bb47-7e33517b84d0 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:55.237702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:55.238616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:55.238616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:55.238850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:55.312960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:55.314954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28bb9b-4c67-4cb6-8599-1e3d83a42128 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:55.325207 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1004/2004] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:55.643427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:55.711790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae4379-2e3d-4b96-9e68-7e5a258984a0 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:55.716675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:55.717314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:55.717651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:55.718161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] PATH_INFO: `/v3/users/a063616e6da747fba3e8bcff2930328d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:55.719386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a063616e6da747fba3e8bcff2930328d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:55.721371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:55.780973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a063616e6da747fba3e8bcff2930328d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:55.790643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a063616e6da747fba3e8bcff2930328d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:55.791535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a063616e6da747fba3e8bcff2930328d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:55.800502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a063616e6da747fba3e8bcff2930328d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:55.815218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a063616e6da747fba3e8bcff2930328d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:55.821931 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1001/2005] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:55 2022] DELETE /identity/v3/users/a063616e6da747fba3e8bcff2930328d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:55.828431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:55.828724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:55.829013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:55.850626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:55.852140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:55.921615 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1005/2006] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:55.931222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:55.932876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:55.994424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:55.996696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:56.009934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:56.042453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:56.049842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d3620-2321-40b1-a6d7-6a533c13f0bd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:56.057263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:56.058214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:56.058487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:56.058916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:56.072413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:56.075008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:56.076377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462c9e8-4716-40a4-862a-1148935204a5 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:56.084877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:56.085521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:56.085796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:56.086074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:56.087905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:56.091296 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1002/2007] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:56.174656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:56.178170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:56.189289 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1006/2008] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:18:56.419785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:56.422720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:56.460252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741913ac-8264-48bf-a072-d74930d00409 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:56.468039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:56.469264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:56.469579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:56.470418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] PATH_INFO: `/v3/projects/c3740a90e833482eb73f43c592d57f86` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:56.471278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3740a90e833482eb73f43c592d57f86)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:56.473430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:56.536589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3740a90e833482eb73f43c592d57f86', 'request_id': 'req-f282485e-7a30-466f-9bab-228e8f947ad7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.542841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3740a90e833482eb73f43c592d57f86', 'request_id': 'req-f282485e-7a30-466f-9bab-228e8f947ad7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.564349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3740a90e833482eb73f43c592d57f86', 'request_id': 'req-f282485e-7a30-466f-9bab-228e8f947ad7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.585666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] The token cache is being invalidate because project c3740a90e833482eb73f43c592d57f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:56.586007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.587624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.589732 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1003/2009] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:56 2022] DELETE /identity/v3/projects/c3740a90e833482eb73f43c592d57f86 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:56.594414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:56.617869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b2c9-dad3-43f0-a1b2-7f3bc244cec0 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:56.707658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:56.708532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:56.708951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:56.709239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] PATH_INFO: `/v3/users/13f377a69b13469ca209769e6fb7771a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:56.710576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f377a69b13469ca209769e6fb7771a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:56.712600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:56.779641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f377a69b13469ca209769e6fb7771a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.795008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f377a69b13469ca209769e6fb7771a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.795961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f377a69b13469ca209769e6fb7771a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.796648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f377a69b13469ca209769e6fb7771a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.801513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:56.806057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:56.813573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:56.818455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-6d1e6368-0800-4263-aca0-12eb2d6b85b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f377a69b13469ca209769e6fb7771a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.834830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282485e-7a30-466f-9bab-228e8f947ad7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:56.837580 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1007/2010] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:56 2022] DELETE /identity/v3/users/13f377a69b13469ca209769e6fb7771a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:56.844793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:56.845532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:56.845900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:56.846312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] PATH_INFO: `/v3/users/049ffd0a3afe477f8cb3e3715bdd8d42` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:56.847963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=049ffd0a3afe477f8cb3e3715bdd8d42)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:56.850317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:56.961398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049ffd0a3afe477f8cb3e3715bdd8d42'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.976354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049ffd0a3afe477f8cb3e3715bdd8d42'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.976952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049ffd0a3afe477f8cb3e3715bdd8d42'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:56.988430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049ffd0a3afe477f8cb3e3715bdd8d42'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.004194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049ffd0a3afe477f8cb3e3715bdd8d42'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.012188 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1004/2011] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:56 2022] DELETE /identity/v3/users/049ffd0a3afe477f8cb3e3715bdd8d42 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:57.017459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.017994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.018179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.043393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:57.044708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.131358 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1008/2012] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:57.146286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:57.148551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.219474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:57.229338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ae55-d490-443b-95d9-d4f1ebd9d2b0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:57.236138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:57.237063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.237555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.238320 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.253415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:57.255710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:57.267247 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1005/2013] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:57.584643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:57.589667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.618426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075f0e0-5a95-475d-be45-38032ea1cc7c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:57.624367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:57.625825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.625825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.625825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] PATH_INFO: `/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.626882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d841fd8bffeb4c73ab197c83fbc9a5b4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:57.628856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:57.650457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:57.652889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.674747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1696b-610e-4cc8-8427-2a1511156304 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:57.681238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:57.682242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.683002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.684270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] PATH_INFO: `/v3/projects/cf59f5f3240f4960a7c1b8630d4c357d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.687389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf59f5f3240f4960a7c1b8630d4c357d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:57.689790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:57.711751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd841fd8bffeb4c73ab197c83fbc9a5b4', 'request_id': 'req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.720761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd841fd8bffeb4c73ab197c83fbc9a5b4', 'request_id': 'req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.728134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd841fd8bffeb4c73ab197c83fbc9a5b4', 'request_id': 'req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.744182 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] The token cache is being invalidate because project d841fd8bffeb4c73ab197c83fbc9a5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:57.744549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.750126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-ad7808ba-3eed-4464-b20d-fcb79dc2e5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.755344 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1009/2014] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:57 2022] DELETE /identity/v3/projects/d841fd8bffeb4c73ab197c83fbc9a5b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:57.755504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf59f5f3240f4960a7c1b8630d4c357d', 'request_id': 'req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.757814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d3473-f6e7-40a2-90d7-7b21f8b024e3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.758442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d3473-f6e7-40a2-90d7-7b21f8b024e3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.759224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d3473-f6e7-40a2-90d7-7b21f8b024e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.759415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf59f5f3240f4960a7c1b8630d4c357d', 'request_id': 'req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.769691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf59f5f3240f4960a7c1b8630d4c357d', 'request_id': 'req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.782706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] The token cache is being invalidate because project cf59f5f3240f4960a7c1b8630d4c357d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:57.783002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.783773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:57.784527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-318d3473-f6e7-40a2-90d7-7b21f8b024e3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:57.785926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-318d3473-f6e7-40a2-90d7-7b21f8b024e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.786366 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1006/2015] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:57 2022] DELETE /identity/v3/projects/cf59f5f3240f4960a7c1b8630d4c357d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:57.790280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:57.791668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.895465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e5c4c-8a64-4dcd-b82d-4433788ad796 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:57.900976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:57.901973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.902375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.902733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] PATH_INFO: `/v3/users/9e2e97cc5ac1446884ae67b691beedc6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.904064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2e97cc5ac1446884ae67b691beedc6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:57.906343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:57.919609 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1010/2016] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:57.922335 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.922633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.922919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.934863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:57.956777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:57.958382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:57.974601 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1011/2017] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:57.975629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:57.988754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf13e06-71d5-42f6-8bad-f85356380b42 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:57.992658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:57.993371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:57.993800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:57.994132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:57.994962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:57.995340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:57.997845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.004226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2e97cc5ac1446884ae67b691beedc6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.018350 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1012/2018] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:58.019609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.021994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.022770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2e97cc5ac1446884ae67b691beedc6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.023783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2e97cc5ac1446884ae67b691beedc6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.033245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2e97cc5ac1446884ae67b691beedc6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.038298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda11e-3ad3-4f1c-bdee-ae23fcef8ad2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.042566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:58.049821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2e97cc5ac1446884ae67b691beedc6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.053379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.054370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.055729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.056333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] PATH_INFO: `/v3/users/6d5528194cf84ead93354c532b2353de` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.057928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5528194cf84ead93354c532b2353de)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.058823 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1007/2019] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:57 2022] DELETE /identity/v3/users/9e2e97cc5ac1446884ae67b691beedc6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:58.059830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.064185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.068490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.172213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5528194cf84ead93354c532b2353de'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.191656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5528194cf84ead93354c532b2353de'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.193106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5528194cf84ead93354c532b2353de'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.194904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5528194cf84ead93354c532b2353de'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.228191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb9fed-a4de-4666-b64f-068e352c32db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.228899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7983d14d-97f3-4178-a1d1-a03973bd9239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5528194cf84ead93354c532b2353de'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.244666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.252091 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1013/2020] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:58 2022] DELETE /identity/v3/users/6d5528194cf84ead93354c532b2353de => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:58.254800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.255300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.255759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.257682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.258109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.258435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.258646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.263696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.305913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:58.307444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.331059 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1008/2021] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:58 2022] POST /identity/v3/projects => generated 371 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:58.332026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.336584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.388665 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1014/2022] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:18:58.399451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.402960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.501883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6d7cb-ca11-4411-8df6-baabdf27567e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.510040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.511015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.511374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.511903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.512932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.516265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.546570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e8a02-498c-45a4-8f9b-ba5289f7be68 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.547614 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1009/2023] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:58 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:58.552101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.566355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:58.587381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be49c-e445-4a32-870b-67733e284832 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.598142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.599074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.600082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.601124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.603099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.609891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.634698 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1010/2024] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:18:58.636140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.640997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.660065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.660718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.660995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.661570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.672255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2732-e29b-478e-a9a9-cf3419891b7b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.677991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.678868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.679162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.679441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] PATH_INFO: `/v3/projects/aecedafdf42149058eb4eb65d088e88d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.680671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecedafdf42149058eb4eb65d088e88d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.682043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.682663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.684286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.700410 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1015/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:58.702233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.722303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff494ff4-3b56-48b4-b15e-459c20d0b549 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.729878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.731229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.731919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.732413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.734169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.736198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.760921 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1016/2026] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:18:58.763465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.783482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecedafdf42149058eb4eb65d088e88d', 'request_id': 'req-6edf2455-9bd2-4234-90e8-edc0bd677b1e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.785403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:58.791245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c4e21-5290-4e47-8166-1020fc163c52 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.801109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecedafdf42149058eb4eb65d088e88d', 'request_id': 'req-6edf2455-9bd2-4234-90e8-edc0bd677b1e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.815448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecedafdf42149058eb4eb65d088e88d', 'request_id': 'req-6edf2455-9bd2-4234-90e8-edc0bd677b1e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.857511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] The token cache is being invalidate because project aecedafdf42149058eb4eb65d088e88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:58.857784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.859467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6edf2455-9bd2-4234-90e8-edc0bd677b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:58.864712 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1011/2027] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:58 2022] DELETE /identity/v3/projects/aecedafdf42149058eb4eb65d088e88d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:58.871960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.872187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.872684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.903736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:58.904618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.905585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.906101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] PATH_INFO: `/v3/projects/68109e62560047efb26dff354a681a10/users/49c57f94b3b340b08022c6b8a17b209f/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.919266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:58.920257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.926836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68109e62560047efb26dff354a681a10, user_id=49c57f94b3b340b08022c6b8a17b209f, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:58.929925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cccce-7b81-461d-8dc1-1b366a7399b9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:58.930362 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1012/2028] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:58.937451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:58.940167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:58.949981 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1017/2029] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:18:58 2022] PUT /identity/v3/projects/68109e62560047efb26dff354a681a10/users/49c57f94b3b340b08022c6b8a17b209f/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:58.952436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847734f-d0db-4e2a-9385-6747ed57f1e0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:58.952986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847734f-d0db-4e2a-9385-6747ed57f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:58.953336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847734f-d0db-4e2a-9385-6747ed57f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:58.958517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e8534-1829-4f84-ae32-2e3ff6782c09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:58.995922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6847734f-d0db-4e2a-9385-6747ed57f1e0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:58.997920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6847734f-d0db-4e2a-9385-6747ed57f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.035267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.035943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.036301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.036517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] PATH_INFO: `/v3/users/a37a1ca90169481ea15adca03ce91c2a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.038259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37a1ca90169481ea15adca03ce91c2a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.040275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.078779 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1018/2030] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:59.080139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.080436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.080980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.103979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:59.107071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.113588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37a1ca90169481ea15adca03ce91c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.115808 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1019/2031] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:59.116696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.130686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37a1ca90169481ea15adca03ce91c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.131465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37a1ca90169481ea15adca03ce91c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.132702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74e820-731e-4a19-b25a-99f274d51a0f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.137645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.138389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.138537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.139198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.140469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:18:59.140784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.142414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.143348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37a1ca90169481ea15adca03ce91c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.163151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37a1ca90169481ea15adca03ce91c2a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.169861 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1020/2032] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:18:59.171050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.176544 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1013/2033] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:58 2022] DELETE /identity/v3/users/a37a1ca90169481ea15adca03ce91c2a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:59.177612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.177937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.179151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.212798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9354a-e23a-4778-b799-15dfae49eced admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.225141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:59.251393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b87651-f6ca-442f-ae02-2923eba07325 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.256462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.257108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.257398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.258179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.260563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.268858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:59.305201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.306413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.306413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.307238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] PATH_INFO: `/v3/projects/0183f7966b614609b36afc54a1ee0b37` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.309409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0183f7966b614609b36afc54a1ee0b37)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.313121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.359589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.361435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.372482 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1014/2034] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:18:59.373166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.375310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.377581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0183f7966b614609b36afc54a1ee0b37', 'request_id': 'req-847e89ad-3e0e-4603-b560-7812f15b1071'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.384494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0183f7966b614609b36afc54a1ee0b37', 'request_id': 'req-847e89ad-3e0e-4603-b560-7812f15b1071'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.388910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd253658-a355-4edd-bb7f-878f5378b1a8 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.393386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0183f7966b614609b36afc54a1ee0b37', 'request_id': 'req-847e89ad-3e0e-4603-b560-7812f15b1071'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.412189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] The token cache is being invalidate because project 0183f7966b614609b36afc54a1ee0b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:18:59.412921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.414052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-847e89ad-3e0e-4603-b560-7812f15b1071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.417218 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1021/2035] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:18:59 2022] DELETE /identity/v3/projects/0183f7966b614609b36afc54a1ee0b37 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:59.419479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.419839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.420205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.455287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:18:59.457725 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.487760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.489003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.489788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.490640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.491552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.494331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.535587 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1015/2036] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:18:59 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:59.537162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.541018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.555194 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1022/2037] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:18:59.556399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.566893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.583408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a0dab-e444-4c8a-bbb3-3c66c23a3db6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.651735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab4970-21d6-40ea-8891-b9a3cc3c1747 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.653274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:59.661015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.662325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.662763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.664019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] PATH_INFO: `/v3/users/dda8e0c4268345b1af1b093a3a979fb7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.665757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda8e0c4268345b1af1b093a3a979fb7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.668484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.686032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.688092 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.688520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.688907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.690237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:18:59.695549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:18:59.714090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:18:59.725194 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1023/2038] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:18:59 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:18:59.726157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.732700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.745827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda8e0c4268345b1af1b093a3a979fb7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.759895 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda8e0c4268345b1af1b093a3a979fb7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.761450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda8e0c4268345b1af1b093a3a979fb7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.776680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda8e0c4268345b1af1b093a3a979fb7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.805154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c9d252c-3f11-4e00-9fbf-b3f794f12a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda8e0c4268345b1af1b093a3a979fb7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:18:59.815016 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1016/2039] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:18:59 2022] DELETE /identity/v3/users/dda8e0c4268345b1af1b093a3a979fb7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:18:59.816524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.817398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.821560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa00f37-2d0d-4689-9a27-42d8dc6d3667 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:18:59.828200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.833598 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1017/2040] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:18:59 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:18:59.836621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:18:59.841346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:18:59.959990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:18:59.960681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:18:59.960997 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:18:59.962223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:18:59.968687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.036675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f259cc-06bc-4c27-9fc4-c021428bc0a3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.046539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.048451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.049531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.050029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.052201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.056433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42b1be-d2af-448a-9452-1d817c4bcaf9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.072731 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.074857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.080974 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1018/2041] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:00.089039 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1024/2042] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:00.089578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac2c6-7345-4031-93e2-57d0b5225da0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.089836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac2c6-7345-4031-93e2-57d0b5225da0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.090018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac2c6-7345-4031-93e2-57d0b5225da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.090114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.111165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffb0e9-caee-4773-8394-11e51de74240 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.122808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.125046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.125046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.125046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.128164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.132224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.145063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4c8ac2c6-7345-4031-93e2-57d0b5225da0 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:00.148072 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1025/2043] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:00.152034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4c8ac2c6-7345-4031-93e2-57d0b5225da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.152342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.165409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20702-228e-46d1-98a6-f53d9723035a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.173226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.173889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.174327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.175525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] PATH_INFO: `/v3/projects/2be69d2ef7ab43a39628ebbbcac6585f/users/7957a6e6a0054236a8a0b2bda267933d/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.194959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be69d2ef7ab43a39628ebbbcac6585f, user_id=7957a6e6a0054236a8a0b2bda267933d, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.198228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.211020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:00.218944 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1026/2044] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:00 2022] PUT /identity/v3/projects/2be69d2ef7ab43a39628ebbbcac6585f/users/7957a6e6a0054236a8a0b2bda267933d/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:00.220586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.240340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.315381 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1019/2045] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:00.317830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.318210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.318569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.372089 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] MFA Rules not processed for user `7957a6e6a0054236a8a0b2bda267933d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:00.375398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.392186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8ff4d-2d51-4c40-86eb-004e7ca5b84e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.398588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:00.405221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.408287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.408287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.408551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] PATH_INFO: `/v3/users/70f5f62cc219459c9ed63a66c526cef5` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.410306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f5f62cc219459c9ed63a66c526cef5)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.412879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.515154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f5f62cc219459c9ed63a66c526cef5'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.520675 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1020/2046] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:00.524133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.525596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.526410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f5f62cc219459c9ed63a66c526cef5'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.528863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f5f62cc219459c9ed63a66c526cef5'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.530545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f5f62cc219459c9ed63a66c526cef5'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.571220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f5f62cc219459c9ed63a66c526cef5'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.622897 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1027/2047] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:00 2022] DELETE /identity/v3/users/70f5f62cc219459c9ed63a66c526cef5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:00.624441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.632282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.637621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45421-1a2d-4894-8f36-9ed4f78c1b91 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.735925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163f50f-68d1-48c8-b30f-dec4b999a02e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.741829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.741977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.742400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.742688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] PATH_INFO: `/v3/projects/2130835d2b1241068b8e228002fbf70b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.743976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2130835d2b1241068b8e228002fbf70b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.746140 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.770451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.771090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.771376 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.771981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.773875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:00.774508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.795208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.799021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.819849 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1021/2048] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:00.820577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:00.821956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.837361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb9468-1d8a-4aec-9ad3-9de9be0b762c service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:00.845535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2130835d2b1241068b8e228002fbf70b', 'request_id': 'req-9f734aed-8228-4801-898b-e9887e1f4121'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.852206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2130835d2b1241068b8e228002fbf70b', 'request_id': 'req-9f734aed-8228-4801-898b-e9887e1f4121'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.859782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2130835d2b1241068b8e228002fbf70b', 'request_id': 'req-9f734aed-8228-4801-898b-e9887e1f4121'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.877144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] The token cache is being invalidate because project 2130835d2b1241068b8e228002fbf70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:00.877934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.878478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9f734aed-8228-4801-898b-e9887e1f4121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:00.883635 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1028/2049] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:00 2022] DELETE /identity/v3/projects/2130835d2b1241068b8e228002fbf70b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:00.883635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.883635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.883635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.921223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] MFA Rules not processed for user `49c57f94b3b340b08022c6b8a17b209f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:00.922140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:00.922877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:00.938453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:00.938971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.939323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.939805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:00.941092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:00.943358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667f68b-19c8-4235-ae88-2b5d1049ee4e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:00.985483 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1022/2050] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:00 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:00.986619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce80c-e927-4e28-8d00-617c3e5a6898 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:00.986909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce80c-e927-4e28-8d00-617c3e5a6898 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:00.987185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce80c-e927-4e28-8d00-617c3e5a6898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.012697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-796ce80c-e927-4e28-8d00-617c3e5a6898 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:01.014815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-796ce80c-e927-4e28-8d00-617c3e5a6898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.019209 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1029/2051] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:01.020264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.021854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.042012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2734508-fd6f-47c8-8779-977a74e8af2c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.103767 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1023/2052] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:01.108881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.109218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.109543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.116606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.117717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.118012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.118296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] PATH_INFO: `/v3/projects/cf6680ba6159440895028edb142312f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.120398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6680ba6159440895028edb142312f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.122361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.132384 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:01.133708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.142239 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1024/2053] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:01.143212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.144487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.156979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25987f-c872-4afb-92c9-e9d89801cce5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.164200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.164840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.165229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.165622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.166430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.169006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.182186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:01.193061 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1025/2054] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/users => generated 306 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:01.194406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.196474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6680ba6159440895028edb142312f9', 'request_id': 'req-2a83ded7-55f2-4083-822b-b12541fa4956'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.197180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.204037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6680ba6159440895028edb142312f9', 'request_id': 'req-2a83ded7-55f2-4083-822b-b12541fa4956'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.210660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96372e-5fb4-4ea9-baba-5c68b5db389f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.210889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6680ba6159440895028edb142312f9', 'request_id': 'req-2a83ded7-55f2-4083-822b-b12541fa4956'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.227002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] The token cache is being invalidate because project cf6680ba6159440895028edb142312f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:01.227308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.228952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.230795 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1030/2055] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:01 2022] DELETE /identity/v3/projects/cf6680ba6159440895028edb142312f9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:01.231611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.245267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.288984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.290295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.291050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.291050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.291807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.293876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461d98a-27d3-4fe0-9544-7aab283070b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.328522 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1026/2056] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:01.328723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83ded7-55f2-4083-822b-b12541fa4956 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.328819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.328819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.328819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.348087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:01.349315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.384995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:01.394404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.395118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.395482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.395833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.398193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.416580 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1027/2057] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:01.417565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.418844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.432536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3282f0-4780-4438-b785-d84f87e18fa1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.437436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.447169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.447469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.447757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.448549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.450141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.461459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1028/2058] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:01.462545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.464408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.475358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.476846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.478507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd448c-9b8d-43e4-94d7-c8e60d8128e7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.485847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.486850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.487211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.487591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] PATH_INFO: `/v3/users/d5fa62c6bbaf497e83847f2e6ff5466a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.489081 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1031/2059] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:01.489932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.491782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.496784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fa62c6bbaf497e83847f2e6ff5466a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.499711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.507308 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107e834-c748-4145-9e02-c2e939dd7221 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.512419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.513052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.513501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.513815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.514713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.516850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.556759 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1032/2060] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/users => generated 293 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:01.557982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.568603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fa62c6bbaf497e83847f2e6ff5466a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.574666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203499c-53e7-47eb-a524-95d7e1c550c0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.582852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.583683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.583807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.584132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.584278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fa62c6bbaf497e83847f2e6ff5466a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.584849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:01.584957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fa62c6bbaf497e83847f2e6ff5466a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.585178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.586969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.600547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fa62c6bbaf497e83847f2e6ff5466a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.611603 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1033/2061] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:01.612420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.619850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:01.626920 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394520-4866-4aae-adf0-b1abeec0d4b1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.628054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fa62c6bbaf497e83847f2e6ff5466a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:01.634406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.635212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.635612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.635985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] PATH_INFO: `/v3/projects/20c79c71356b40cc8cb06404f2609e3d/users/8c982f8536c84c30b72ee896da781d19/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.645411 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1029/2062] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:01 2022] DELETE /identity/v3/users/d5fa62c6bbaf497e83847f2e6ff5466a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:01.646807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.648562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.656588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c79c71356b40cc8cb06404f2609e3d, user_id=8c982f8536c84c30b72ee896da781d19, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.660018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.679724 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1034/2063] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:01 2022] PUT /identity/v3/projects/20c79c71356b40cc8cb06404f2609e3d/users/8c982f8536c84c30b72ee896da781d19/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:01.680650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.682846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.781273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524f41d-36ef-4b04-9c60-a35476391ba1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.786464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.787160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.787448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.787780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.788500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.790889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbd78-7944-4f4f-b1fa-7676e5225084 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.791176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.805525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.807165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.807969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.808261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.808994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.816937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.829624 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1035/2064] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:01.831253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.835451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:01.845922 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1030/2065] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:01.846954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:01.864908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32708d-c8cc-4e96-9914-d4feb8a5ebfa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.921171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:01.957425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dcdf4-923c-42f4-8720-fb23ae5dd2c1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:01.964581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.965360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.965749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.966152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.967105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.969525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.971603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:01.972332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:01.972715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:01.972907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:01.974268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:01.976544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:01.982599 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1036/2066] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:01.988630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.004795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aded-e163-4359-b9ad-099af2482dc0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.012609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.015765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.015765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.015765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] PATH_INFO: `/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a/users/ba3e0465b45746eabb724a6cfe4274fc/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.024869 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1031/2067] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:01 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:02.026080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.039199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bd8cf431f744b7b2e85e3a4829456a, user_id=ba3e0465b45746eabb724a6cfe4274fc, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.042289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.043210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd793134-248f-4737-89fd-e7ed20194479 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.066594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.068235 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1037/2068] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:01 2022] PUT /identity/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a/users/ba3e0465b45746eabb724a6cfe4274fc/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.068813 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.069265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.070182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] PATH_INFO: `/v3/projects/20c79c71356b40cc8cb06404f2609e3d/users/8c982f8536c84c30b72ee896da781d19/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.070342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.073163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c79c71356b40cc8cb06404f2609e3d, user_id=8c982f8536c84c30b72ee896da781d19, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.075880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.089556 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1032/2069] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:02 2022] PUT /identity/v3/projects/20c79c71356b40cc8cb06404f2609e3d/users/8c982f8536c84c30b72ee896da781d19/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.099969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.184641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.199590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9fa6d-78e2-40e3-8cf0-98e162a7aad0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.212446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.213091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.213434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.213647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.214348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.216004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f23fe-dc07-49b1-96a1-52bb03afb67b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.224334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d3ad1-57a3-422c-9096-bd8336c32f96 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.228868 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1033/2070] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:02.230030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.230318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.230599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.232720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.234236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.234529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.234813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.236862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.238486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.250683 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1038/2071] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:02.251606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.254796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.275230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] MFA Rules not processed for user `8c982f8536c84c30b72ee896da781d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:02.276286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.281900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40c66-7cbb-44ad-9a98-d87e57a42f6f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.295080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.296096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.296650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.297038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] PATH_INFO: `/v3/projects/7caaab24c78e4beabf37b2bface19680` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.298705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7caaab24c78e4beabf37b2bface19680)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.301992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.376028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7caaab24c78e4beabf37b2bface19680', 'request_id': 'req-512eb16a-061a-44b0-8a21-f239966ba01a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.385241 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7caaab24c78e4beabf37b2bface19680', 'request_id': 'req-512eb16a-061a-44b0-8a21-f239966ba01a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.391822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7caaab24c78e4beabf37b2bface19680', 'request_id': 'req-512eb16a-061a-44b0-8a21-f239966ba01a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.409915 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1034/2072] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:02.410535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] The token cache is being invalidate because project 7caaab24c78e4beabf37b2bface19680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:02.410840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.410949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.411541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.416093 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1039/2073] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:02 2022] DELETE /identity/v3/projects/7caaab24c78e4beabf37b2bface19680 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.418970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.421598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.435446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a690e9-d04f-41ed-ae8c-2eee26720e8e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.479693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.515904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512eb16a-061a-44b0-8a21-f239966ba01a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.516123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.517971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.517971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.517971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] PATH_INFO: `/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a/users/ba3e0465b45746eabb724a6cfe4274fc/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.519568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bd8cf431f744b7b2e85e3a4829456a, user_id=ba3e0465b45746eabb724a6cfe4274fc, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.522289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.522543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.523222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.523570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.523907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.524858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.526760 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.534033 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1035/2074] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:02 2022] PUT /identity/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a/users/ba3e0465b45746eabb724a6cfe4274fc/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.534859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.536478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.544520 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1040/2075] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:02.544520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.544520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.557495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa18ea7-dde5-4a68-826f-dbfddad5f0a2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.613215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287800be-cd0a-41e9-ac26-ec5fdc603441 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.617277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.620415 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.621391 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.621513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.621857 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] PATH_INFO: `/v3/projects/0a8b7c924bdb428e86c611ecf6b5e60f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.624532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8b7c924bdb428e86c611ecf6b5e60f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.626988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.636209 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.636962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.637314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.637595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] PATH_INFO: `/v3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.639103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67b6b5a77ab4ca4b5d3790f9a9ac626)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.641513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.687286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8b7c924bdb428e86c611ecf6b5e60f', 'request_id': 'req-3562b18c-3174-49c2-b6fd-3092ce1200ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.695212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8b7c924bdb428e86c611ecf6b5e60f', 'request_id': 'req-3562b18c-3174-49c2-b6fd-3092ce1200ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.698467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67b6b5a77ab4ca4b5d3790f9a9ac626'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.706903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67b6b5a77ab4ca4b5d3790f9a9ac626'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.707123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8b7c924bdb428e86c611ecf6b5e60f', 'request_id': 'req-3562b18c-3174-49c2-b6fd-3092ce1200ac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.708114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67b6b5a77ab4ca4b5d3790f9a9ac626'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.708733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67b6b5a77ab4ca4b5d3790f9a9ac626'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.720568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] The token cache is being invalidate because project 0a8b7c924bdb428e86c611ecf6b5e60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:02.721081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.721852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.724151 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1036/2076] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:02 2022] DELETE /identity/v3/projects/0a8b7c924bdb428e86c611ecf6b5e60f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.724954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.726418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.728051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67b6b5a77ab4ca4b5d3790f9a9ac626'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:02.746452 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1041/2077] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:02 2022] DELETE /identity/v3/users/a67b6b5a77ab4ca4b5d3790f9a9ac626 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.752814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:02.756706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.830315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562b18c-3174-49c2-b6fd-3092ce1200ac admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.844550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:02.876878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30345a3-7820-4257-8903-9d790e9a619e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:02.884131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.886375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.886674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.886954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] PATH_INFO: `/v3/projects/4f78ac26a4ba421985e749701fa5bba5/users/383b0db78e8045fbac702874fdc3a9ab/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.910282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:02.911053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:02.911342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:02.911624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:02.913668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:02.921268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f78ac26a4ba421985e749701fa5bba5, user_id=383b0db78e8045fbac702874fdc3a9ab, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:02.926839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:02.993622 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1042/2078] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:02 2022] PUT /identity/v3/projects/4f78ac26a4ba421985e749701fa5bba5/users/383b0db78e8045fbac702874fdc3a9ab/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:02.997113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.005389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.016549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.018226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35c45d-f75d-4925-82ac-a853e8ab3969 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.030135 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1037/2079] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:03.031559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.032578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.032578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.084507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] MFA Rules not processed for user `383b0db78e8045fbac702874fdc3a9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:03.085826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.220035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.228440 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1038/2080] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:03.229057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ff01-4fb5-43e2-9db5-a5d7dd49c4c0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.230222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.246927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.249221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.249707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.250552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] PATH_INFO: `/v3/users/fb450a407e7544a2af78535f340466ca` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.252683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb450a407e7544a2af78535f340466ca)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.257199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.311609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.319726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78a9be-40f2-4155-a9e5-2e0de3e7bf99 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.323680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.329829 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.330273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.330854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.333082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb450a407e7544a2af78535f340466ca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.333488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.342992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb450a407e7544a2af78535f340466ca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.343803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb450a407e7544a2af78535f340466ca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.344568 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb450a407e7544a2af78535f340466ca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.362986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb450a407e7544a2af78535f340466ca'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.380569 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1043/2081] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:02 2022] DELETE /identity/v3/users/fb450a407e7544a2af78535f340466ca => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:03.381515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.395478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.415645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.417153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.442397 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1039/2082] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:03.444255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:03.447618 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.470388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f53a3-24bc-424f-87cd-c507624816db service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.614976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.615986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.616341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.616712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] PATH_INFO: `/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.619435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e07ea82fd74ec68d9c76adbcdeaab3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.625229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75079f86-66fc-43ca-9a01-3a0941aff32e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:03.625427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.642464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:03.644203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.644637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.645152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.651549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.712309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e07ea82fd74ec68d9c76adbcdeaab3', 'request_id': 'req-df9b2c70-459f-45c5-96b1-2380e5f166c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.719568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e07ea82fd74ec68d9c76adbcdeaab3', 'request_id': 'req-df9b2c70-459f-45c5-96b1-2380e5f166c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.729839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e07ea82fd74ec68d9c76adbcdeaab3', 'request_id': 'req-df9b2c70-459f-45c5-96b1-2380e5f166c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.760047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] The token cache is being invalidate because project 08e07ea82fd74ec68d9c76adbcdeaab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:03.760340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.763428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-df9b2c70-459f-45c5-96b1-2380e5f166c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:03.773295 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1040/2083] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:03 2022] DELETE /identity/v3/projects/08e07ea82fd74ec68d9c76adbcdeaab3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:03.773295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.773295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.773295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.793767 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:03.797363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3096b6b-9976-4214-8e25-35faa4e4b111 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:03.829644 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1044/2084] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:03.833680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383921c1-b81c-4436-b512-e4699b8ac956 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:03.834093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383921c1-b81c-4436-b512-e4699b8ac956 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:03.835192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383921c1-b81c-4436-b512-e4699b8ac956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:03.838824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] MFA Rules not processed for user `ba3e0465b45746eabb724a6cfe4274fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:03.854618 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:03.881314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:03.947115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-383921c1-b81c-4436-b512-e4699b8ac956 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:03.949365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-383921c1-b81c-4436-b512-e4699b8ac956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.001013 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:04.031954 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1041/2085] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.034079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.042243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.073746 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1045/2086] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.076128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbe2-c8de-4a7b-88ee-19e8b977aeff None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.077213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbe2-c8de-4a7b-88ee-19e8b977aeff None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.077783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0dbe2-c8de-4a7b-88ee-19e8b977aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.103477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a8d0dbe2-c8de-4a7b-88ee-19e8b977aeff None None] MFA Rules not processed for user `49c57f94b3b340b08022c6b8a17b209f`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.106858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a8d0dbe2-c8de-4a7b-88ee-19e8b977aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.223308 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1046/2087] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.226811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.227722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.228329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.256723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.258056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.267394 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1047/2088] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.268443 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.269819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.280939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c614a-cd6e-4063-aa34-347b776bbfeb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.284101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0e809-469e-4105-92b0-94c187e7c62b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.287434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.288216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.288594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.288879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] PATH_INFO: `/v3/users/383b0db78e8045fbac702874fdc3a9ab` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.289791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.290159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383b0db78e8045fbac702874fdc3a9ab)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.290721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.291215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.291596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] PATH_INFO: `/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.292235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.293429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac1672e0ddd4e2f8700c36f7752d6f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.296372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.356643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac1672e0ddd4e2f8700c36f7752d6f9', 'request_id': 'req-f73c446d-0f5d-400d-a13e-922b590d845a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.367518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383b0db78e8045fbac702874fdc3a9ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.368554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac1672e0ddd4e2f8700c36f7752d6f9', 'request_id': 'req-f73c446d-0f5d-400d-a13e-922b590d845a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.376712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac1672e0ddd4e2f8700c36f7752d6f9', 'request_id': 'req-f73c446d-0f5d-400d-a13e-922b590d845a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.380634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383b0db78e8045fbac702874fdc3a9ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.383926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383b0db78e8045fbac702874fdc3a9ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.401207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383b0db78e8045fbac702874fdc3a9ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.412074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] The token cache is being invalidate because project dac1672e0ddd4e2f8700c36f7752d6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:04.412074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.413989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.415925 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1048/2089] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:04 2022] DELETE /identity/v3/projects/dac1672e0ddd4e2f8700c36f7752d6f9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:04.416863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.418883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383b0db78e8045fbac702874fdc3a9ab'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:04.419116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.426086 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1042/2090] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:04 2022] DELETE /identity/v3/users/383b0db78e8045fbac702874fdc3a9ab => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:04.427238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.428731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.480410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:04.493244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:04.521070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b835fb-0a07-4913-9f78-51e38e0a82d9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.527519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.527904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c446d-0f5d-400d-a13e-922b590d845a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.528341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.528726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.529010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.532210 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:04.532591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.534781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd82f8-ae33-4dea-bdda-b9918e579576 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.553308 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1043/2091] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:04.554544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac014-5cba-4a54-bda2-001cd48170c2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.554838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac014-5cba-4a54-bda2-001cd48170c2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.555120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac014-5cba-4a54-bda2-001cd48170c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.594443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-454ac014-5cba-4a54-bda2-001cd48170c2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.596329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-454ac014-5cba-4a54-bda2-001cd48170c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.616094 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1044/2092] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.617984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.618333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.619562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.637598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.638311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.640277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.640728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.643794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.648291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.650052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.666469 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1045/2093] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.667569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.681372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3276-d836-4766-b51d-76c9a1439e19 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.688033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.690277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.691102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.691397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.692620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.695096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7663a-a267-4d3c-aecd-899a90072a4f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.725741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.727537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.729518 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1046/2094] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:04.731027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.731027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.731266 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.742127 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1049/2095] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:04.743338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.744564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.756670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:04.757981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:04.831829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df3421-c047-4764-9071-4f613b1ffb6e service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.849883 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1047/2096] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:04.853453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.866566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90d690-d5d2-4c4d-8358-85e4cdde6120 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.872567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.874161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.874449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.874902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.875582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.877735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.900610 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:04.909690 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1048/2097] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:04.910886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.912370 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.913121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.913502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.913874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.925273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baab06-48f9-4468-9479-31fad9f17ea1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.925448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.927205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.930697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.931889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.932592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.932872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.933726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:04.934053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.938856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.950801 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1050/2098] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:04.951677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.962485 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1049/2099] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:04.963912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e54c-14e3-4f5e-a30f-05431b07be91 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.965983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.970427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.971145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.971602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.972015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.972783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.974699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:04.984413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80d72f-0fd4-40a6-992b-cc1bc10c82bd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:04.988512 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1051/2100] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:04.990756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:04.991420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:04.991816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:04.992225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:04.993618 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:04.994529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:04.995137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.006309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e89b-e47e-4956-9a57-7ad9ef449bce admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.014463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.015447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.015736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.016520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.017283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.019594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.043591 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1050/2101] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:04 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:05.047079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.057519 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1052/2102] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:05.058894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.091342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc35273-a742-4f3a-8130-2214b8fb73a2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.132404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:05.156406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1e00c-d94c-4732-a351-211953b9b41b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.166897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.167843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.168160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.168553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.169310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.176668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.223074 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1051/2103] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:05.227093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.231109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.234000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.234391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.234955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] PATH_INFO: `/v3/projects/f64edaed9261417bbfe18f85bd21bef2/users/05c5a66bee374a458adea27e3539bc6c/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.245763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa41e8-d576-4af7-996e-03c34258a411 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.251735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.252642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.253371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.253796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.254051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64edaed9261417bbfe18f85bd21bef2, user_id=05c5a66bee374a458adea27e3539bc6c, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.254976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.256775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.257419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f70b5c-464d-48fb-b780-db357d7a7fca admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.276485 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1053/2104] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:05 2022] PUT /identity/v3/projects/f64edaed9261417bbfe18f85bd21bef2/users/05c5a66bee374a458adea27e3539bc6c/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:05.299959 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1052/2105] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:05.300532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.300532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.300532 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.300737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.321205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3f87-e523-4e86-afbe-e5d63ab78d8a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.334426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] MFA Rules not processed for user `05c5a66bee374a458adea27e3539bc6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:05.335673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:05.457740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.458033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.458315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.458597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.460481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.462352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.481596 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1053/2106] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:05.482920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.513696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284d04c-cc54-419a-b917-bc921497b7a7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.516087 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1054/2107] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:05.519284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.525772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.525973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.526167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.526460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] PATH_INFO: `/v3/projects/413ef6552f784cc69f3ea2c207fb22ac/users/92896f905cc946f5804b56ad50785dd6/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.534962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d793c-6fc0-4511-a588-3f02e6f5b449 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.542050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.543680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.544372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.544980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.547798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.548593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=413ef6552f784cc69f3ea2c207fb22ac, user_id=92896f905cc946f5804b56ad50785dd6, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.550752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.552238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386f34e-d326-4010-9e2e-cbaf912b54bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.586478 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1054/2108] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:05 2022] PUT /identity/v3/projects/413ef6552f784cc69f3ea2c207fb22ac/users/92896f905cc946f5804b56ad50785dd6/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:05.588568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.588904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.589296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.609415 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1055/2109] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:05.613011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.637237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:05.646067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] MFA Rules not processed for user `92896f905cc946f5804b56ad50785dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:05.662721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:05.768686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca743e19-3ccf-4b0c-8be7-afbe3b051d22 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.774989 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.775184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.775468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.775742 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.780371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.782990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.812836 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1055/2110] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:05.816069 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1056/2111] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:05.817007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.817143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.828231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b657c37-7484-4a80-bc79-d2128b52e9b3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.830303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f03c-4162-443b-b8c0-b2f11e4661a3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.835433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.836243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.836628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.837362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.837832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.839508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.843010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.844726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.845024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.845307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.846103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.884639 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1057/2112] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:05.886904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.889018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:05.891642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:05.928014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283bc13-3da4-4c6b-91f4-39f7cb863be9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:05.942526 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1056/2113] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:05 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:05.942526 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:05.945482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:05.945835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:05.946889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:05.947155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] PATH_INFO: `/v3/projects/4f78ac26a4ba421985e749701fa5bba5` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:05.948080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:05.956737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f78ac26a4ba421985e749701fa5bba5)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:05.960346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.052909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b7deb-42f0-4948-9730-6543189e3cea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.068662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f78ac26a4ba421985e749701fa5bba5', 'request_id': 'req-a58e0b61-675b-4a46-9429-60bf7e02c95e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.084685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f78ac26a4ba421985e749701fa5bba5', 'request_id': 'req-a58e0b61-675b-4a46-9429-60bf7e02c95e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.100602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f78ac26a4ba421985e749701fa5bba5', 'request_id': 'req-a58e0b61-675b-4a46-9429-60bf7e02c95e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.118959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] The token cache is being invalidate because project 4f78ac26a4ba421985e749701fa5bba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:06.119283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.120724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:06.121744 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1058/2114] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:05 2022] DELETE /identity/v3/projects/4f78ac26a4ba421985e749701fa5bba5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:06.124287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.126549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.204518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.205312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.205865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.206142 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] PATH_INFO: `/v3/projects/37f55635381242928e12ac552f6d0e0d/users/c7838c69542145f8a4a87218ebe02c05/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.226775 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0b61-675b-4a46-9429-60bf7e02c95e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.231957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.233469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.233469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.233898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.234612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.236527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000f88b-1ca9-44e7-8e72-01598401236c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.244101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f55635381242928e12ac552f6d0e0d, user_id=c7838c69542145f8a4a87218ebe02c05, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.249989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.284367 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1059/2115] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:06.284367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.284367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.284367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.290637 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1057/2116] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:05 2022] PUT /identity/v3/projects/37f55635381242928e12ac552f6d0e0d/users/c7838c69542145f8a4a87218ebe02c05/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:06.291673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.295671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:06.310594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:06.313103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.423313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb00ae-8a4e-4bd3-90d5-5d14885aa09c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.455139 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1060/2117] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:06.455139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.456289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.456289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.456289 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.456550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.457194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.461538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39972b1-3e85-436e-924e-1c016fa744cf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.463455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.479951 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1058/2118] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:06.480740 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.481031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.481312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.507079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117269a-e6e9-4779-85b7-a620eec791a1 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.513361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:06.516009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:06.525703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.527876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.528198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.528476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.532942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.533998 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1059/2119] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:06.535442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.536876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.550841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d5790-4a8f-465d-9735-261f5e61c952 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.557317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.558157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.558522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.558809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.559567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.562326 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.573973 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1061/2120] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:06.575851 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1060/2121] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:06.578171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.580222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.596862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631f3a-8fb7-40e4-a47a-37a1b200aa0b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.597239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a148e6-9be6-4ea4-8583-3d07c279f987 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.603552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.604107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.604498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.605026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.605756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:06.606135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.608057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.611438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.612219 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.612508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.612788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] PATH_INFO: `/v3/projects/3ae0597d6c9c43429d9fb07304db1107/users/6ffc3b05deca438a847411290c4a05d0/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.624715 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1062/2122] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:06.625461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.630063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:06.643797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae0597d6c9c43429d9fb07304db1107, user_id=6ffc3b05deca438a847411290c4a05d0, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.646819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.668821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ea9a-f23c-4369-8e30-a07d5c376f99 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.673956 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1061/2123] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:06 2022] PUT /identity/v3/projects/3ae0597d6c9c43429d9fb07304db1107/users/6ffc3b05deca438a847411290c4a05d0/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:06.675027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:06.824813 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:06.827707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.829053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.830770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] PATH_INFO: `/v3/projects/37f55635381242928e12ac552f6d0e0d/users/c7838c69542145f8a4a87218ebe02c05/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.852925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f55635381242928e12ac552f6d0e0d, user_id=c7838c69542145f8a4a87218ebe02c05, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:06.860139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149c06-99e6-441d-9417-d3f2c593d36a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:06.883166 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1063/2124] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:06 2022] PUT /identity/v3/projects/37f55635381242928e12ac552f6d0e0d/users/c7838c69542145f8a4a87218ebe02c05/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:06.885273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897659-80ae-492d-bae1-b4e8c54475f4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:06.885711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897659-80ae-492d-bae1-b4e8c54475f4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:06.886137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897659-80ae-492d-bae1-b4e8c54475f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:06.898141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b4557-cb90-4d37-84cf-647ff8d5829b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:06.933325 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-80897659-80ae-492d-bae1-b4e8c54475f4 None None] MFA Rules not processed for user `6ffc3b05deca438a847411290c4a05d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:06.935034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-80897659-80ae-492d-bae1-b4e8c54475f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.036790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.037776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.038246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.038702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.039644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.042359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.051538 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1064/2125] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:07.052893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.061490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.061855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.082904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:07.089755 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1062/2126] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:06 2022] POST /identity/v3/projects => generated 375 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.091167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.134464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] MFA Rules not processed for user `c7838c69542145f8a4a87218ebe02c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:07.135890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.218481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91450a39-f5c0-4570-ac81-8043c58543da admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.231979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.233301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.233849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.234189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.235009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.237157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.302641 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1065/2127] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:07.303549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.327833 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1063/2128] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.328778 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.331860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcf9d5-f959-46f5-a4f6-91fe3ca8451a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.333655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.351714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:07.474067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606109b-1ea9-437e-bae6-f1ea2d77fd70 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.483162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.485409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.486021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.486304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.486993 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.487104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.488225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.488514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.488792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.489321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.491319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.520287 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1066/2129] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.521194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.535286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75134733-14b3-4b48-879f-e5a232049f31 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.546353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.547566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.547566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.548022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.548883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.552334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.582544 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1067/2130] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/users => generated 294 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:07.583649 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.597349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.598810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.599885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478091f4-82f4-4ffe-80d3-c3a0460cd68e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.609218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.610574 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1064/2131] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:07.611447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.621290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.621846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.622309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.623962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad97b2-f28d-4740-b006-ce3701a9d971 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.625488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.629648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.642952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.643787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.644694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.645111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.645954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.647698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.656229 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1068/2132] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:07.662261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.662849 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1065/2133] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:07.663874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.674269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8ea1-f8c8-483e-99b3-4785daf3bc75 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.676029 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6d6c1-2934-42d5-844c-0eb59857648e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.679476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.680357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.680784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.681137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.681841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.682569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.683472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.683625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.684097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.684564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] PATH_INFO: `/v3/projects/8998f1e112f34af8837318320fb5c6ff/users/47f076af7cc745e6958563ebe2819402/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.700181 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1069/2134] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:07.702178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.706319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8998f1e112f34af8837318320fb5c6ff, user_id=47f076af7cc745e6958563ebe2819402, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.709604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.718741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738130f-d537-41fa-bf69-7e779c1ae605 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.729928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:07.730968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.731256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.731590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] PATH_INFO: `/v3/projects/99e427056bb04f6fb49fbec1652e7561/users/b8fb8bcf93ae4c46aff942d15cb36652/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.733567 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1066/2135] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:07 2022] PUT /identity/v3/projects/8998f1e112f34af8837318320fb5c6ff/users/47f076af7cc745e6958563ebe2819402/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:07.739202 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:07.776975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e427056bb04f6fb49fbec1652e7561, user_id=b8fb8bcf93ae4c46aff942d15cb36652, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:07.780753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c515173-a7ee-4d2c-8c83-890b688e1ebb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:07.799972 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1070/2136] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:07 2022] PUT /identity/v3/projects/99e427056bb04f6fb49fbec1652e7561/users/b8fb8bcf93ae4c46aff942d15cb36652/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:07.820600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:07.821134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:07.821564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:07.870270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1148e-901a-4f11-93b0-fdb6cdf3cda4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:07.906531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] MFA Rules not processed for user `b8fb8bcf93ae4c46aff942d15cb36652`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:07.908798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:07.925439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:07.935298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:08.000586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.001224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.001539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.001922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.002634 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.004274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.031235 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1067/2137] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:08.035145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.054664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8aefc-8681-42d2-bab3-aafe4cfcce00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.071178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.071883 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.072197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.072479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] PATH_INFO: `/v3/projects/8998f1e112f34af8837318320fb5c6ff/users/47f076af7cc745e6958563ebe2819402/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.077711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8998f1e112f34af8837318320fb5c6ff, user_id=47f076af7cc745e6958563ebe2819402, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.080231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a520134-482b-4a66-9022-bb71a4bb03ee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.108746 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1068/2138] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:08 2022] PUT /identity/v3/projects/8998f1e112f34af8837318320fb5c6ff/users/47f076af7cc745e6958563ebe2819402/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:08.120308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.120599 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.120874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.131232 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1071/2139] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:08.132704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.166510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886d988-e577-4550-89ac-810c1cb51a1d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.169887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] MFA Rules not processed for user `47f076af7cc745e6958563ebe2819402`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:08.171695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.263826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.267479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.267958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.268419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.269311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.271673 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.320047 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1069/2140] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:08.325728 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1072/2141] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:08 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:08.330329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.334564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.338054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.355790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2e12-a8cb-4f93-b814-d343e2234ae2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.433283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c635f10-5f9e-4a01-b65a-7dd194170de8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.439310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.439990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.440284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.440567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.520594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.522180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.522757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.524696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.527328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.531561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.541204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:08.574667 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1070/2142] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:08 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:08.577182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.577488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.579261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.580248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.591282 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1073/2143] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:08.593403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.598199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcb823-b217-4ca9-8b84-13b624f58476 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.606413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8e80-a1cf-4b04-bd7f-ead17142175a service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.606611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.606611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.606611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.607015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] PATH_INFO: `/v3/users/7957a6e6a0054236a8a0b2bda267933d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.609301 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7957a6e6a0054236a8a0b2bda267933d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.611679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.612851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.612851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.613225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.613707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.614489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.616247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.631160 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1074/2144] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:08.635701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.649255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:08.660992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b09e-a12c-4b48-8063-ec02df411ea7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.676059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.676829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.678093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.679115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] PATH_INFO: `/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2/users/a65195d4f6ea47e9a5ff5bcdbab80a57/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.706900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7957a6e6a0054236a8a0b2bda267933d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:08.719078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d343c4ca21e4bfd81542b6812bbcce2, user_id=a65195d4f6ea47e9a5ff5bcdbab80a57, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.719802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7957a6e6a0054236a8a0b2bda267933d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:08.720754 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7957a6e6a0054236a8a0b2bda267933d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:08.728398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.738076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7957a6e6a0054236a8a0b2bda267933d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:08.757489 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1075/2145] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:08 2022] PUT /identity/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2/users/a65195d4f6ea47e9a5ff5bcdbab80a57/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:08.758340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.759730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7957a6e6a0054236a8a0b2bda267933d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:08.776296 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1071/2146] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:08 2022] DELETE /identity/v3/users/7957a6e6a0054236a8a0b2bda267933d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:08.778318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:08.780963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:08.894352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd06e2-8718-472a-8165-581efcd05a86 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.924086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dcf4-1689-4f8d-9252-3a3f500a28d5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:08.938441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:08.939600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.940700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.941572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:08.942994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:08.945931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c606e2d-aa21-4524-a517-47080c927e13 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:08.978061 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1072/2147] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:08.982402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:08.982402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:08.982402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.027144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:09.028797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.044428 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1073/2148] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:09.046547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:09.053273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:09.053955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:09.054255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:09.054542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.057210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.076826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980368c1-20bf-4d06-b143-d4895019ce73 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:09.087888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:09.093046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:09.093046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:09.093408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] PATH_INFO: `/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2/users/a65195d4f6ea47e9a5ff5bcdbab80a57/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.098335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d343c4ca21e4bfd81542b6812bbcce2, user_id=a65195d4f6ea47e9a5ff5bcdbab80a57, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:09.101831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:09.124370 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1074/2149] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:09 2022] PUT /identity/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2/users/a65195d4f6ea47e9a5ff5bcdbab80a57/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:09.124966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:09.128284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.183882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:09.186514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c5e90-f70f-44e9-8fcc-6586bf13501d service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:09.202518 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1076/2150] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:09.204300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:09.204592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:09.205019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.246785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b06b3d-6d79-4032-bf28-d117fc4f6b89 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:09.251420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:09.251821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:09.252333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:09.252629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.261866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] MFA Rules not processed for user `a65195d4f6ea47e9a5ff5bcdbab80a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:09.265816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.272201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:09.320195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:09.387189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:09.390254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:09.421242 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1075/2151] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:09.440615 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1077/2152] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:09.649654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:09.652630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.789601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a2ac9-dcab-49e1-b8f0-089851de5556 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:09.796614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:09.797312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:09.798417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:09.798887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:09.802656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:09.914950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:09.918328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:09.944467 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1076/2153] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:11.056089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:11.058676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:11.074622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca1c86-e146-43b9-9466-c7f549e49bd6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:11.082100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:11.083109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:11.083423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:11.083901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] PATH_INFO: `/v3/projects/2be69d2ef7ab43a39628ebbbcac6585f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:11.085160 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be69d2ef7ab43a39628ebbbcac6585f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:11.087156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:11.161584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be69d2ef7ab43a39628ebbbcac6585f', 'request_id': 'req-639645c0-fcb2-4d61-a00c-a4949573e70f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.170876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be69d2ef7ab43a39628ebbbcac6585f', 'request_id': 'req-639645c0-fcb2-4d61-a00c-a4949573e70f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.180575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be69d2ef7ab43a39628ebbbcac6585f', 'request_id': 'req-639645c0-fcb2-4d61-a00c-a4949573e70f'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.196285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] The token cache is being invalidate because project 2be69d2ef7ab43a39628ebbbcac6585f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:11.196601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.197462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.199482 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1078/2154] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:11 2022] DELETE /identity/v3/projects/2be69d2ef7ab43a39628ebbbcac6585f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:11.203705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:11.230709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900656c-be40-4f7e-9889-5a2f33fcdc8d service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:11.327760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:11.328703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:11.329200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:11.329537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] PATH_INFO: `/v3/users/8c982f8536c84c30b72ee896da781d19` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:11.331559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c982f8536c84c30b72ee896da781d19)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:11.334781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:11.362312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:11.391159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c982f8536c84c30b72ee896da781d19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.400549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c982f8536c84c30b72ee896da781d19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.401272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c982f8536c84c30b72ee896da781d19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.408655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c982f8536c84c30b72ee896da781d19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.421314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f14c52f3-5570-4db1-af92-77ed6c9c8e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c982f8536c84c30b72ee896da781d19'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:11.435203 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1077/2155] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:11 2022] DELETE /identity/v3/users/8c982f8536c84c30b72ee896da781d19 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:11.822192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:11.824150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:11.852783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639645c0-fcb2-4d61-a00c-a4949573e70f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:11.972533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:11.972923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:11.973322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:11.973696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] PATH_INFO: `/v3/projects/20c79c71356b40cc8cb06404f2609e3d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:11.975503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c79c71356b40cc8cb06404f2609e3d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:11.977931 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.023919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:12.048407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c79c71356b40cc8cb06404f2609e3d', 'request_id': 'req-436b922e-2551-47d4-9506-9b0c6b3ae80d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.055116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c79c71356b40cc8cb06404f2609e3d', 'request_id': 'req-436b922e-2551-47d4-9506-9b0c6b3ae80d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.064933 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c79c71356b40cc8cb06404f2609e3d', 'request_id': 'req-436b922e-2551-47d4-9506-9b0c6b3ae80d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.080113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] The token cache is being invalidate because project 20c79c71356b40cc8cb06404f2609e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:12.080723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.081699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.085027 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1079/2156] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:11 2022] DELETE /identity/v3/projects/20c79c71356b40cc8cb06404f2609e3d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:12.090735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997650d-5c4b-4d4e-9c6a-27ca1e4df178 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.091164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997650d-5c4b-4d4e-9c6a-27ca1e4df178 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.092873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997650d-5c4b-4d4e-9c6a-27ca1e4df178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.119315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9997650d-5c4b-4d4e-9c6a-27ca1e4df178 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:12.121377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9997650d-5c4b-4d4e-9c6a-27ca1e4df178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.189494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.191500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.251859 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1078/2157] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:12.257242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.257870 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.258314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.312839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:12.314836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.338695 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1079/2158] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:12.344605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.363480 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21a52c-48a8-4263-8e08-226cc10af2f4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.378445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.379263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.379815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.380268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.381771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:12.382329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.388387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.424462 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1080/2159] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:12.426702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.451840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34420b2c-8398-47d7-99ea-11b70a41e69a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.458538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b922e-2551-47d4-9506-9b0c6b3ae80d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.469795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.470430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.470720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.470923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.471073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.471661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.472627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.473164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.474230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.476834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] PATH_INFO: `/v3/users/b8fb8bcf93ae4c46aff942d15cb36652` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.479196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fb8bcf93ae4c46aff942d15cb36652)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.489994 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.527019 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1081/2160] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:12.533468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.569937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fb8bcf93ae4c46aff942d15cb36652'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.578795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fb8bcf93ae4c46aff942d15cb36652'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.579641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fb8bcf93ae4c46aff942d15cb36652'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.580926 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fb8bcf93ae4c46aff942d15cb36652'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.596608 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3901d2be-5bb6-4d26-b2f5-28af66a09b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fb8bcf93ae4c46aff942d15cb36652'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:12.614107 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1080/2161] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:12 2022] DELETE /identity/v3/users/b8fb8bcf93ae4c46aff942d15cb36652 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:12.618833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.619508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.619508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.636156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8137-65b0-4a1e-bf10-7653446db142 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.646472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:12.648044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.650993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:12.696321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:12.766353 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1081/2162] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:12.766353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.766756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.770518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.770518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.770518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.770518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.770876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.772635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.802502 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1082/2163] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:12.805502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.808058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:12.825063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8410490-26d6-41b9-aaad-ddec93c0b3be admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.830351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.831230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.831518 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.831802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.832536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.834135 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.842794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b121b-8796-42d5-8d42-97a7f47326d0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.846484 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1083/2164] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:12.846749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.847098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.847712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.848030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.850228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.861215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.862593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022ce55-b57a-4b31-949c-d11efb17fed4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.862746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.867819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.868655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.869074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.869366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.870305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.872010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5438c6-9b39-4f84-bb80-a29f9057808b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.876853 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1082/2165] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:12.883920 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1084/2166] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:12.889470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:12.900595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d9af-c44f-4724-97dc-7a99cde29833 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:12.906693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:12.907364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.907678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.907986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] PATH_INFO: `/v3/projects/0dd4b04d952b44cca5542eba7530d513/users/e4c756ee9a2d4d6f9dccce15ef87a573/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:12.932887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4b04d952b44cca5542eba7530d513, user_id=e4c756ee9a2d4d6f9dccce15ef87a573, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:12.936173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:12.963752 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1083/2167] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:12 2022] PUT /identity/v3/projects/0dd4b04d952b44cca5542eba7530d513/users/e4c756ee9a2d4d6f9dccce15ef87a573/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:12.965487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:12.965782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:12.966072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.000107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] MFA Rules not processed for user `e4c756ee9a2d4d6f9dccce15ef87a573`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:13.001436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.087418 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1085/2168] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:13.092017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.162622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c357c1-ec34-47bc-a15f-8732c651d012 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.167827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.168479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.168889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.169234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.170491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.172835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.190515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.192802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.213812 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1084/2169] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:13 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:13.214279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c6154-bea4-4bd8-9825-38be6d9e4c6a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.218668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.263276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:13.281646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.282405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.282749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.283037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] PATH_INFO: `/v3/projects/99e427056bb04f6fb49fbec1652e7561` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.284648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e427056bb04f6fb49fbec1652e7561)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.286887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.289586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0885fb-c3bd-45a4-95b4-e458bee43d73 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.294063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:13.296573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.297232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.297516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.297794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.298468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.300426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.322302 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1085/2170] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:13 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:13.326894 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.338397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a71f00-3ccc-4c7c-aaef-3d8d1430c147 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.343338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e427056bb04f6fb49fbec1652e7561', 'request_id': 'req-a310b123-6fad-4bb2-91ed-1b2673c17b56'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.349138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e427056bb04f6fb49fbec1652e7561', 'request_id': 'req-a310b123-6fad-4bb2-91ed-1b2673c17b56'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.357513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e427056bb04f6fb49fbec1652e7561', 'request_id': 'req-a310b123-6fad-4bb2-91ed-1b2673c17b56'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.369619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] The token cache is being invalidate because project 99e427056bb04f6fb49fbec1652e7561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:13.370102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.370846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.372565 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1086/2171] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:13 2022] DELETE /identity/v3/projects/99e427056bb04f6fb49fbec1652e7561 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:13.377723 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.379884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.410942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.411585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.411861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.412193 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.413012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.414635 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.428223 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1086/2172] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:13.430298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.432233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.445816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f50ba-182f-47fa-aa92-c661643ecd24 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.453640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.454337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.454623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.454906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] PATH_INFO: `/v3/projects/f0c4bbfd65304e9dac56c18e342cd258/users/0051ae48dd1f47399fb4ac9164288fdc/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.476179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c4bbfd65304e9dac56c18e342cd258, user_id=0051ae48dd1f47399fb4ac9164288fdc, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.476179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.479656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310b123-6fad-4bb2-91ed-1b2673c17b56 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.496363 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1087/2173] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:13 2022] PUT /identity/v3/projects/f0c4bbfd65304e9dac56c18e342cd258/users/0051ae48dd1f47399fb4ac9164288fdc/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:13.496541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.496541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.496541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.496541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] PATH_INFO: `/v3/users/a65195d4f6ea47e9a5ff5bcdbab80a57` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.497538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.500321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65195d4f6ea47e9a5ff5bcdbab80a57)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.503479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.563468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65195d4f6ea47e9a5ff5bcdbab80a57'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.571865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65195d4f6ea47e9a5ff5bcdbab80a57'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.572537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65195d4f6ea47e9a5ff5bcdbab80a57'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.573665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f2aa-62b1-4798-a441-9d65bb09d5c1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.579035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.579658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.579956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.580261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.581224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.582108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65195d4f6ea47e9a5ff5bcdbab80a57'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.582827 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.594604 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1088/2174] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:13.595290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.597716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65195d4f6ea47e9a5ff5bcdbab80a57'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:13.598311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.604927 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1087/2175] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:13 2022] DELETE /identity/v3/users/a65195d4f6ea47e9a5ff5bcdbab80a57 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:13.608973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.610263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.626679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:13.642947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:13.670625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506de88d-6c8b-4633-a190-a499622c669d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.695159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abd8e5-47a0-4016-b584-f005908192ec admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:13.700175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.700852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.701693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.702670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] PATH_INFO: `/v3/projects/f0c4bbfd65304e9dac56c18e342cd258/users/0051ae48dd1f47399fb4ac9164288fdc/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.704859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c4bbfd65304e9dac56c18e342cd258, user_id=0051ae48dd1f47399fb4ac9164288fdc, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.707903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13271341-061b-421a-95ec-a0aef3951fdd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.722270 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1088/2176] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:13 2022] PUT /identity/v3/projects/f0c4bbfd65304e9dac56c18e342cd258/users/0051ae48dd1f47399fb4ac9164288fdc/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:13.729520 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:13.730269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.730382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.730604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.732712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:13.733561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:13.733848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:13.734544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.766546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] MFA Rules not processed for user `0051ae48dd1f47399fb4ac9164288fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:13.768230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.816972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:13.820070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:13.833514 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1089/2177] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:13.884008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.886249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.896850 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1089/2178] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:13.910287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:13.911865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:13.912453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7443c-aa84-4b48-8a1a-408d549a70d1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.005273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6d66-7d9b-4d40-a438-1dbc82b145fc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.010052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.010903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.011356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.011843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.023972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.026214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.035208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.036109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.036672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.036910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] PATH_INFO: `/v3/users/92896f905cc946f5804b56ad50785dd6` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.038893 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1090/2179] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:14.039024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92896f905cc946f5804b56ad50785dd6)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.039993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.041215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.041375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.088529 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05441-390d-4800-ae7e-cada515c11f0 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.097268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.097919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.100182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.101892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] PATH_INFO: `/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.105184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d343c4ca21e4bfd81542b6812bbcce2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.107558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.107956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.112366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92896f905cc946f5804b56ad50785dd6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.127847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92896f905cc946f5804b56ad50785dd6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.130424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92896f905cc946f5804b56ad50785dd6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.131479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92896f905cc946f5804b56ad50785dd6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.149201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-87cf73ef-13ee-41c3-a1ab-40facfa96a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92896f905cc946f5804b56ad50785dd6'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.168784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.200067 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1090/2180] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:13 2022] DELETE /identity/v3/users/92896f905cc946f5804b56ad50785dd6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:14.204458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d343c4ca21e4bfd81542b6812bbcce2', 'request_id': 'req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.205138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de189c3-05e6-44b3-8e06-6c443b2728f3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.205680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de189c3-05e6-44b3-8e06-6c443b2728f3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.205964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de189c3-05e6-44b3-8e06-6c443b2728f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.214605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d343c4ca21e4bfd81542b6812bbcce2', 'request_id': 'req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.227490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d343c4ca21e4bfd81542b6812bbcce2', 'request_id': 'req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.236585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-4de189c3-05e6-44b3-8e06-6c443b2728f3 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:14.237738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4de189c3-05e6-44b3-8e06-6c443b2728f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.244204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] The token cache is being invalidate because project 9d343c4ca21e4bfd81542b6812bbcce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:14.244652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.245447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.250861 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1091/2181] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/projects/9d343c4ca21e4bfd81542b6812bbcce2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:14.250861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.252164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.326065 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1091/2182] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:14.328234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.328533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.329098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.353231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:14.354761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.360693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca066a23-1c28-4540-a5c3-2090c2a7f8d2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.364395 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1092/2183] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:14.365862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.366513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.366803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.367086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] PATH_INFO: `/v3/users/e4c756ee9a2d4d6f9dccce15ef87a573` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.368323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4c756ee9a2d4d6f9dccce15ef87a573)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.369399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.370255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.371328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.432812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4c756ee9a2d4d6f9dccce15ef87a573'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.442185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b6fc1-3ebf-448a-b58f-d8c58a0ab45e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.444285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4c756ee9a2d4d6f9dccce15ef87a573'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.445068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4c756ee9a2d4d6f9dccce15ef87a573'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.450259 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.450557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.450852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.451704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.454899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4c756ee9a2d4d6f9dccce15ef87a573'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.462224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.463868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87b359-45a9-4042-998b-1890262eb0a0 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.468939 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-378f0c42-8ace-45b9-8b6f-af5bef87ac7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4c756ee9a2d4d6f9dccce15ef87a573'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.474629 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1093/2184] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:14.475751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.476069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.476458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.493926 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1092/2185] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/users/e4c756ee9a2d4d6f9dccce15ef87a573 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:14.498008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:14.499228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.499703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.500174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.500461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.524482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:14.526143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.560540 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.571823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.572126 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1094/2186] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:14.577939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.589279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b128a4-0a54-41f8-8003-f7564be87e43 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.595974 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.596678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.597025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.597393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.598125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:14.598455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.600072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.619886 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1095/2187] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:19:14.620267 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1093/2188] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:14.621839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.626874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.629204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.636884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5459-c616-41b6-8aef-ad812d42feb5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.646819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.648502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.649428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.649854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.650759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.653809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.699440 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1096/2189] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:14.700345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.700465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c351-df17-48c0-9cd9-62ad0fefe5fb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.754886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.755641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.755876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.756276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.781788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5050e41-5a16-4f21-9d84-17c3a1fa7883 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.786689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.787313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.787595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.787869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.789087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.790542 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.814526 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1097/2190] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:14 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:14.815300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.817007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.829331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2505b-acdf-4100-85d1-fbf4f117f4d9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.834192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.834818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.835121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.835379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] PATH_INFO: `/v3/projects/413ef6552f784cc69f3ea2c207fb22ac` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.836558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413ef6552f784cc69f3ea2c207fb22ac)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.838465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.839838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.841302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.851647 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1094/2191] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:14.852336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.862156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7dae4-97cd-4e22-98d8-5abd497855c5 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.867686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.868429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.868719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.869003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.869802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.871568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.882470 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1095/2192] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:14.886552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.895029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413ef6552f784cc69f3ea2c207fb22ac', 'request_id': 'req-a85be63e-5d7d-4873-a872-bf8b10a070f9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.896879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ea565-f989-4f4c-a225-117075a6e38e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:14.903910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413ef6552f784cc69f3ea2c207fb22ac', 'request_id': 'req-a85be63e-5d7d-4873-a872-bf8b10a070f9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.913975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413ef6552f784cc69f3ea2c207fb22ac', 'request_id': 'req-a85be63e-5d7d-4873-a872-bf8b10a070f9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.930427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] The token cache is being invalidate because project 413ef6552f784cc69f3ea2c207fb22ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:14.930694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.931378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:14.931916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.933349 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1098/2193] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/projects/413ef6552f784cc69f3ea2c207fb22ac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:14.937773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.939498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:14.969093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:14.969715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:14.969998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:14.970274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:14.970974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:14.972800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:14.986169 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1096/2194] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:14.986715 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:14.990615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:14.993175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.008926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f2c56-d486-463e-ae4d-eeb080dbf9b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.017229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.019749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.020410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.020812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] PATH_INFO: `/v3/projects/f6acab6d5ed849c2bb49fc683f99455a/users/6289b7eaf74440469f91b645ccc246c1/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.023187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be63e-5d7d-4873-a872-bf8b10a070f9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.031577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.031577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.031577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.031577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] PATH_INFO: `/v3/users/6ffc3b05deca438a847411290c4a05d0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.032272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffc3b05deca438a847411290c4a05d0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.033873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.039808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6acab6d5ed849c2bb49fc683f99455a, user_id=6289b7eaf74440469f91b645ccc246c1, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.044615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c49c3-ccd4-4f87-93a9-7db58e10f1f4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.067499 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1097/2195] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:14 2022] PUT /identity/v3/projects/f6acab6d5ed849c2bb49fc683f99455a/users/6289b7eaf74440469f91b645ccc246c1/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.078171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.078500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.078886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.114953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffc3b05deca438a847411290c4a05d0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.116110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] MFA Rules not processed for user `6289b7eaf74440469f91b645ccc246c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:15.118084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.125964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffc3b05deca438a847411290c4a05d0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.127235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffc3b05deca438a847411290c4a05d0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.127872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffc3b05deca438a847411290c4a05d0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.143959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffc3b05deca438a847411290c4a05d0'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.167090 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1099/2196] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:14 2022] DELETE /identity/v3/users/6ffc3b05deca438a847411290c4a05d0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.199492 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1098/2197] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:15.203776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.205806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.214925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.217016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.319605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12cd5a-e207-4b35-8b29-8104cc9b2674 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.322190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a754ed-cfd5-4232-b17d-75ccf5db025b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.324750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.325579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.325771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.326084 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] PATH_INFO: `/v3/projects/0dd4b04d952b44cca5542eba7530d513` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.327575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd4b04d952b44cca5542eba7530d513)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.328088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.328769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.329054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.329331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.329714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.330208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.332672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.367400 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1100/2198] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:15.368438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.376912 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:15.391882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd4b04d952b44cca5542eba7530d513', 'request_id': 'req-1aa0a301-1fa8-4b90-8ca1-3b197c718389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.398091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd4b04d952b44cca5542eba7530d513', 'request_id': 'req-1aa0a301-1fa8-4b90-8ca1-3b197c718389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.407470 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd4b04d952b44cca5542eba7530d513', 'request_id': 'req-1aa0a301-1fa8-4b90-8ca1-3b197c718389'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.432585 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] The token cache is being invalidate because project 0dd4b04d952b44cca5542eba7530d513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:15.432926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.433488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.441417 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1099/2199] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:15 2022] DELETE /identity/v3/projects/0dd4b04d952b44cca5542eba7530d513 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.445124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.454626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.457586 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:15.486098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55245-1880-4af8-b1b6-627934b07e78 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.587991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0a301-1fa8-4b90-8ca1-3b197c718389 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.593836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.594811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.595102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.595636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.596546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.598571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.610840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.611030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.611212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.611498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] PATH_INFO: `/v3/users/0051ae48dd1f47399fb4ac9164288fdc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.612982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0051ae48dd1f47399fb4ac9164288fdc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.615262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.639982 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1101/2200] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:15.644194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.646668 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.665567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcf1db-1deb-46ae-8e53-a0240207c91a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.673461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.674155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.674396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.674729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.676024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.677416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.697674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0051ae48dd1f47399fb4ac9164288fdc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.698492 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1102/2201] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:15.700187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.708807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0051ae48dd1f47399fb4ac9164288fdc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.710748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0051ae48dd1f47399fb4ac9164288fdc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.716079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8e3a3-8aa9-4dc0-8747-a84b203501ab admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.723026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0051ae48dd1f47399fb4ac9164288fdc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.725677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.726632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.727260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.727782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.728908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.731233 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.740578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0051ae48dd1f47399fb4ac9164288fdc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:15.754974 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1100/2202] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:15 2022] DELETE /identity/v3/users/0051ae48dd1f47399fb4ac9164288fdc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:15.756273 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1103/2203] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:15.757555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.759055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.810621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:15.813548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:15.839522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28272f02-0e31-4123-82c0-ff284cc33425 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.871149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:15.903292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89d08-39e7-49cc-98b7-09298a12d37a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:15.909636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.910218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.910508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.910792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] PATH_INFO: `/v3/projects/6212102d25c344ebb2582d39ad98d67c/users/b836f986f8e54568926f29767d25ea9b/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.930090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:15.930990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.931281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.931639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] PATH_INFO: `/v3/projects/3ae0597d6c9c43429d9fb07304db1107` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:15.933131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae0597d6c9c43429d9fb07304db1107)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.935738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6212102d25c344ebb2582d39ad98d67c, user_id=b836f986f8e54568926f29767d25ea9b, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:15.936561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.939070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb340c-0d54-406d-b2ce-58765c6e03b3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:15.955991 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1101/2204] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:15 2022] PUT /identity/v3/projects/6212102d25c344ebb2582d39ad98d67c/users/b836f986f8e54568926f29767d25ea9b/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:15.968293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:15.968643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:15.968998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.004206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] MFA Rules not processed for user `b836f986f8e54568926f29767d25ea9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:16.005871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.008357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae0597d6c9c43429d9fb07304db1107', 'request_id': 'req-71b50c82-c100-4af3-a4a5-5f5575e1ae72'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.015472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae0597d6c9c43429d9fb07304db1107', 'request_id': 'req-71b50c82-c100-4af3-a4a5-5f5575e1ae72'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.018104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:16.024923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae0597d6c9c43429d9fb07304db1107', 'request_id': 'req-71b50c82-c100-4af3-a4a5-5f5575e1ae72'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.043227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] The token cache is being invalidate because project 3ae0597d6c9c43429d9fb07304db1107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:16.043911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.045197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.047615 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1104/2205] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:15 2022] DELETE /identity/v3/projects/3ae0597d6c9c43429d9fb07304db1107 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:16.051868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.053372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.148716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b50c82-c100-4af3-a4a5-5f5575e1ae72 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.155135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.156071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.156358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.156780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] PATH_INFO: `/v3/users/47f076af7cc745e6958563ebe2819402` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.158028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f076af7cc745e6958563ebe2819402)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.158650 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1102/2206] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:16.160220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.162915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.164564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.191137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96bb23-c050-46a7-81c2-b1f3ee4195e1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.203986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.203986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.207307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.207667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.208459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.211051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.233435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f076af7cc745e6958563ebe2819402'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.247713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f076af7cc745e6958563ebe2819402'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.249187 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f076af7cc745e6958563ebe2819402'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.249919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f076af7cc745e6958563ebe2819402'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.261427 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1103/2207] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:16.262433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.265726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.285918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f076af7cc745e6958563ebe2819402'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.306617 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1105/2208] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:16 2022] DELETE /identity/v3/users/47f076af7cc745e6958563ebe2819402 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:16.308700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.309058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.371037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50d7a-7afc-4ab6-a8e6-2546596679cd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.421316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba32c54-0b4e-43e4-b32b-35b130343d20 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.430806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.431923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.432440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.432728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.433422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.436203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.450103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:16.456261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:16.475733 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1106/2209] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:16.476157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.476674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.476799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.477299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.477934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] PATH_INFO: `/v3/projects/f0c4bbfd65304e9dac56c18e342cd258` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.480076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c4bbfd65304e9dac56c18e342cd258)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.482871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.490081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b580-4842-4d54-9e66-9164674f02e3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.495157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.495779 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.496107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.496445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.497181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.498961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.514643 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1107/2210] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:16.515826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.526938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050033-1ec4-4be1-895a-d46f895d28e9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.534131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.534880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.535169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.535522 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] PATH_INFO: `/v3/projects/c7f05233aac2499fb2197c94e1f7d085/users/d71fc0c9c4ca4dd78c72a77508eb2fb3/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.557103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f05233aac2499fb2197c94e1f7d085, user_id=d71fc0c9c4ca4dd78c72a77508eb2fb3, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.557466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c4bbfd65304e9dac56c18e342cd258', 'request_id': 'req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.566254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c4bbfd65304e9dac56c18e342cd258', 'request_id': 'req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.568613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.593500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c4bbfd65304e9dac56c18e342cd258', 'request_id': 'req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.609318 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1108/2211] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:16 2022] PUT /identity/v3/projects/c7f05233aac2499fb2197c94e1f7d085/users/d71fc0c9c4ca4dd78c72a77508eb2fb3/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:16.609874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.631542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] The token cache is being invalidate because project f0c4bbfd65304e9dac56c18e342cd258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:16.631907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.632730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e7bfddb0-3e8a-4d56-b3db-87deb4c7fb9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:16.635030 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1104/2212] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:16 2022] DELETE /identity/v3/projects/f0c4bbfd65304e9dac56c18e342cd258 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:16.643879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fe7-3dd3-4c1b-b3ae-28188fa1a799 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.644805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fe7-3dd3-4c1b-b3ae-28188fa1a799 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.646144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab28fe7-3dd3-4c1b-b3ae-28188fa1a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.703716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5ab28fe7-3dd3-4c1b-b3ae-28188fa1a799 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:16.705023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ab28fe7-3dd3-4c1b-b3ae-28188fa1a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.710638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705bac-5c7e-4b2b-90b6-55c17d0dcf59 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.722254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.723643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.724225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.724696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.727048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.730524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.743818 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1105/2213] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:16.753163 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1109/2214] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:16.755322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.756123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.757012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.757749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.758858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.785011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66ca0-91d2-4e4c-9f63-7d573f3ddb6a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.788741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:16.791318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.793328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.796414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.798670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.799218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] PATH_INFO: `/v3/projects/c7f05233aac2499fb2197c94e1f7d085/users/d71fc0c9c4ca4dd78c72a77508eb2fb3/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.805824 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1106/2215] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:16.806015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f05233aac2499fb2197c94e1f7d085, user_id=d71fc0c9c4ca4dd78c72a77508eb2fb3, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.806612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3da6-bb6b-43e9-8d70-428ed79fc3fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.807594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:16.820819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17077-711e-426b-b043-cbafda32c8c8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:16.828308 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1110/2216] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:16 2022] PUT /identity/v3/projects/c7f05233aac2499fb2197c94e1f7d085/users/d71fc0c9c4ca4dd78c72a77508eb2fb3/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:16.839406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.840413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.842605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.891059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] MFA Rules not processed for user `d71fc0c9c4ca4dd78c72a77508eb2fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:16.893788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:16.936571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:16.939733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:16.940333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:16.940959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:16.942407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:16.942962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:16.946493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:16.991890 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1107/2217] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:19:16.993195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.001019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.016156 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1111/2218] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:17.016808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.018712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5688d-0d1d-4b6c-9d58-1a7bc07ba600 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.036116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.036932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19dd10f-75e6-47dd-a953-215225c8930e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.037136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.037400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.037888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] PATH_INFO: `/v3/projects/8998f1e112f34af8837318320fb5c6ff` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.041663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8998f1e112f34af8837318320fb5c6ff)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.048467 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.049288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.050472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.050472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.050790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.053678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.054911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.101133 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1112/2219] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:17.102573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.110132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.121618 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.141996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.148808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8998f1e112f34af8837318320fb5c6ff', 'request_id': 'req-642ea246-f8e6-4c34-9461-466c97322401'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.159399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8998f1e112f34af8837318320fb5c6ff', 'request_id': 'req-642ea246-f8e6-4c34-9461-466c97322401'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.170793 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8998f1e112f34af8837318320fb5c6ff', 'request_id': 'req-642ea246-f8e6-4c34-9461-466c97322401'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.189000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] The token cache is being invalidate because project 8998f1e112f34af8837318320fb5c6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:17.189284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9eeab1-00f3-4093-9f80-6949ec92e0c8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.189745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.200448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:17.204461 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1108/2220] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:16 2022] DELETE /identity/v3/projects/8998f1e112f34af8837318320fb5c6ff => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:17.209921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.211809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.255453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.256264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.256616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.256913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.258882 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.291726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea246-f8e6-4c34-9461-466c97322401 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.300561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.301232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.301574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.301886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.302558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.304621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2b3df-9a59-4e60-93bd-056adbc09cb3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.328494 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1109/2221] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:17.331068 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.331293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac845-d5bb-4d50-8c4b-bb88f887e068 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.331963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac845-d5bb-4d50-8c4b-bb88f887e068 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.332380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac845-d5bb-4d50-8c4b-bb88f887e068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.335166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.350267 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1113/2222] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:17.351900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.362101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-006ac845-d5bb-4d50-8c4b-bb88f887e068 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:17.363776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-006ac845-d5bb-4d50-8c4b-bb88f887e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.373728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9880e6c-622b-485e-94e3-93a41f4a13aa service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.387960 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1110/2223] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:17.388213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.388213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.388213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.388213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.389364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.389364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.393579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.394243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.394752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.405817 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1114/2224] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:17.410584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.418791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:17.421194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.426022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f632e-ca5c-471f-83df-c41a7f185281 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.436953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.437551 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1111/2225] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:17.437681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.437888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.438222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.438953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.441600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.444598 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.451809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4baba-c525-4746-a7a9-8ea18c7873bc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.457668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.458366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.458645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.459020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.459610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:17.459915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.460455 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1115/2226] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:17.461598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.465102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.476303 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1112/2227] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:17.476692 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7affa8-2be1-4f5c-ab63-7c9b76632e39 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.480853 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.481619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.482440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.482809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.483166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] PATH_INFO: `/v3/projects/32fd676c702a4c11af46ede85aa54497/users/41a3d80f93a742ba9c1631062bbc07bb/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.497642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9969f5-0cfd-4145-ad13-79471037d8e7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.502941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fd676c702a4c11af46ede85aa54497, user_id=41a3d80f93a742ba9c1631062bbc07bb, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.505393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.506363 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.506786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.507068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.507815 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.509680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.517031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f39e6-029a-4a1d-9fd6-a09748689d86 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.537712 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1116/2228] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:17 2022] PUT /identity/v3/projects/32fd676c702a4c11af46ede85aa54497/users/41a3d80f93a742ba9c1631062bbc07bb/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:17.551606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.552517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.553316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.563413 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1113/2229] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:17.565571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.594448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] MFA Rules not processed for user `41a3d80f93a742ba9c1631062bbc07bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:17.596809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:17.627178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.655076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f977d-a0a6-440f-a4ef-ea0251f02525 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.668193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.668193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.668193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.668193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.668510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.668510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.694426 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1114/2230] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:17.698287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.713801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5b417-cbf3-4280-b748-1c7e238f1bea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.734879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.735515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.735799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.737045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.737931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.739573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.745201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:17.754425 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1117/2231] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:17.758865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.774796 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1115/2232] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:17.775893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.797760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8544cf-5435-4968-8002-5e9f3bb07b51 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.800351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613670-8d17-490e-af46-4bf0139956f0 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.805509 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.816143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.816143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.816143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.816143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.816143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.820280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.821179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.821600 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.822047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.822943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.825035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.852913 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1116/2233] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:17.857847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.877957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918ee7a-2b16-4341-92b4-5a33f8bd3f96 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:17.896102 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1118/2234] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:17.896865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:17.897404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.897688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.897963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] PATH_INFO: `/v3/projects/5713db67b9da48399167374e916f2ae4/users/bbe28d104c0247b8b0b6683cdb9e2d16/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:17.898207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:17.934327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5713db67b9da48399167374e916f2ae4, user_id=bbe28d104c0247b8b0b6683cdb9e2d16, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:17.941681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88354fd6-6470-4962-bfa6-a564758fb20b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:17.962599 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1117/2235] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:17 2022] PUT /identity/v3/projects/5713db67b9da48399167374e916f2ae4/users/bbe28d104c0247b8b0b6683cdb9e2d16/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:17.975461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:17.975810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:17.976584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.013114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8b5a8-9083-4d9d-9627-a78f25eb2bbe admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.023466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] MFA Rules not processed for user `bbe28d104c0247b8b0b6683cdb9e2d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:18.024408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.099804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.100393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.100944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.101099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.101744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.104664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.108080 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1118/2236] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:18.118471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.120438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.131326 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1119/2237] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:17 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:18.135138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.146494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53e5ea-3f7c-49c4-90b7-77ad9fa98f7a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.152144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.152759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.153726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.153726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.154243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.155648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.175306 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1120/2238] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:18.176766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.191065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0893e-5682-4bda-a080-cf48d480e72d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.196799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.197674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.198144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.199976 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.200938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.202756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.207803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40d6f-fa43-48f5-9927-26a4cb976119 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.213091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.213987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.214531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.214981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.215549 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1121/2239] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:18.220185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.233167 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.234693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357dff1-68e2-450b-96c2-cc243bdac3c3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.236063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.240744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.241688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.241880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.242170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] PATH_INFO: `/v3/projects/ec6824d288c54342b7000fff8549789f/users/7e6cf175271242c6a111a85969d027ad/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.249907 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1119/2240] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:18.255983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:18.272541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6824d288c54342b7000fff8549789f, user_id=7e6cf175271242c6a111a85969d027ad, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.275273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafd584-d890-4be4-a016-06c154f0b757 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.276625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.290252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51807-5256-4f1e-8304-df2aca42da25 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.291059 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1122/2241] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:18 2022] PUT /identity/v3/projects/ec6824d288c54342b7000fff8549789f/users/7e6cf175271242c6a111a85969d027ad/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:18.302591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.302951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.303237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.333362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] MFA Rules not processed for user `7e6cf175271242c6a111a85969d027ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:18.334617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.358811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:18.370541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.371280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.371638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.372030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] PATH_INFO: `/v3/users/bbe28d104c0247b8b0b6683cdb9e2d16` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.374030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe28d104c0247b8b0b6683cdb9e2d16)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.375926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.401901 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1123/2242] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:18.406503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.417518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061114-117a-4897-ab45-9d77b0eab600 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.423551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.424563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.424980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.425266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.431810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe28d104c0247b8b0b6683cdb9e2d16'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:18.431987 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.431987 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.444408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe28d104c0247b8b0b6683cdb9e2d16'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:18.445532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe28d104c0247b8b0b6683cdb9e2d16'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:18.456281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe28d104c0247b8b0b6683cdb9e2d16'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:18.463979 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1124/2243] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:18.466937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.473826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c70a995b-f518-4225-a710-c2194dfeecb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe28d104c0247b8b0b6683cdb9e2d16'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:18.485715 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1120/2244] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:18 2022] DELETE /identity/v3/users/bbe28d104c0247b8b0b6683cdb9e2d16 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:18.487812 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.488177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.488555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.511306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:18.512116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.548593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffdce0-7774-4635-a96c-17f5595b381e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.585705 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1121/2245] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:18.598053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.599539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.620577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.621122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.621405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.621688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.622359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.624434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.633125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:18.648865 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1125/2246] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:18.652683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.654853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:18.664605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a8044-c0c8-481d-8b28-f9ad4ad47f89 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.667151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bbd81-77bf-4c71-ac53-bc6831497fb0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.670653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.671438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.671824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.672178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.673771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.674381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.674669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.674946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.675644 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.677271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.682094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.683504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.687661 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1126/2247] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:18.691582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.693698 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1122/2248] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:18.701998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87fb8a-b6f8-46cd-8f09-fa3576395b71 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.707162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.707829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.708154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.708539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] PATH_INFO: `/v3/projects/86fb640029ef4a98a21167fe7b4467b3/users/b5f11212c3f54c6d94b47a1cc5f599cf/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.724659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fb640029ef4a98a21167fe7b4467b3, user_id=b5f11212c3f54c6d94b47a1cc5f599cf, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.727504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.744303 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1127/2249] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:18 2022] PUT /identity/v3/projects/86fb640029ef4a98a21167fe7b4467b3/users/b5f11212c3f54c6d94b47a1cc5f599cf/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:18.748831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.759688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1799-c53f-4c3e-951f-b03973560d5f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.773687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:18.831373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.832041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.832891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.833191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.833907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.835561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6f51c-e388-4c45-ade2-5db3ccb279cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.860394 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1123/2250] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:18.861388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:18.878732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1867b3-b2e3-4401-89a6-34e4b9261bd6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:18.883658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:18.884733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.885194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.885665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] PATH_INFO: `/v3/projects/86fb640029ef4a98a21167fe7b4467b3/users/b5f11212c3f54c6d94b47a1cc5f599cf/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.887804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86fb640029ef4a98a21167fe7b4467b3, user_id=b5f11212c3f54c6d94b47a1cc5f599cf, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:18.890802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:18.903796 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1128/2251] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:18 2022] PUT /identity/v3/projects/86fb640029ef4a98a21167fe7b4467b3/users/b5f11212c3f54c6d94b47a1cc5f599cf/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:18.915746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:18.916429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:18.917087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:18.948490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] MFA Rules not processed for user `b5f11212c3f54c6d94b47a1cc5f599cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:18.949613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.019079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.021447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.066767 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1124/2252] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:19.066767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.066767 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.126337 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963284f0-8a08-4f3a-9389-d1fb7a1ce5b0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.131198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.131850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.132173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.132456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] PATH_INFO: `/v3/projects/5713db67b9da48399167374e916f2ae4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.133675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5713db67b9da48399167374e916f2ae4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.135606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.136877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f51c4-06bd-4743-9709-225ea8cecde6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.141296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.142052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.142247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.142453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.144352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.194563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5713db67b9da48399167374e916f2ae4', 'request_id': 'req-1406dee2-fe99-4591-a4a2-d47243a56220'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.198259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:19.211197 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.212686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.213180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5713db67b9da48399167374e916f2ae4', 'request_id': 'req-1406dee2-fe99-4591-a4a2-d47243a56220'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.223097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5713db67b9da48399167374e916f2ae4', 'request_id': 'req-1406dee2-fe99-4591-a4a2-d47243a56220'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.233203 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1125/2253] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:19.234127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.235523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.236643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] The token cache is being invalidate because project 5713db67b9da48399167374e916f2ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:19.236919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.237565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1406dee2-fe99-4591-a4a2-d47243a56220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.239993 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1129/2254] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:19 2022] DELETE /identity/v3/projects/5713db67b9da48399167374e916f2ae4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:19.245334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f184-adfd-463c-81c2-a979ebbec889 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.245630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f184-adfd-463c-81c2-a979ebbec889 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.245913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23f184-adfd-463c-81c2-a979ebbec889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.248885 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588447-a3ee-4af2-b60a-f6f7922bb0d6 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.266849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7e23f184-adfd-463c-81c2-a979ebbec889 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:19.268375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7e23f184-adfd-463c-81c2-a979ebbec889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.305020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.305642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.305920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.306193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.308733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.320069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:19.366518 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1130/2255] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:19.374328 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.374622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.374914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.391784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.393456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.401321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:19.402721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.404412 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1126/2256] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:19.416941 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1131/2257] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:19.422166 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.433436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0e7ea-382a-4d87-bfc7-d0e17ad62149 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.439753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.446300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.446646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.446932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.447652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:19.447977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.449654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.466936 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1127/2258] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:19.468354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.481581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e06dc-3d44-4f5a-ac6e-3399a6ce0f22 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.488589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.489101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.489389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.489663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.490693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.492685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.539991 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1132/2259] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:19 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:19.543476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.554868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2729b8c-8766-45f1-8814-31334f6b2b19 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.652306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.653056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.653337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.653616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.655385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.656979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.689425 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1128/2260] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:19 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:19.693475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.705704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49649e8-4199-4c3d-ad9a-37ea5840309b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.712946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.713881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.714153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.714430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.715453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.718006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.742408 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1133/2261] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:19.748541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.761915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01296ef-64c7-4fce-84db-b6935a9a8dfb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.766498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.769750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:19.786140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.788715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.789006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.789287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.791559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.797551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.800718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50f174-5296-4352-9ff7-f85554982679 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.817451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.818904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.819872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.820487 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] PATH_INFO: `/v3/users/05c5a66bee374a458adea27e3539bc6c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.823083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c5a66bee374a458adea27e3539bc6c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.828015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.829686 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1129/2262] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:19.834347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:19.865181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d0431-1b21-4a6e-a2c3-3af34c11ae1a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:19.872230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:19.874274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.874846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.874969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] PATH_INFO: `/v3/projects/8a4cb6e6c3394f16b3c26ab916b6c916/users/16dd9266446448ccbb30becb702abfa9/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.901488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:19.927477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4cb6e6c3394f16b3c26ab916b6c916, user_id=16dd9266446448ccbb30becb702abfa9, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:19.930698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345677-18d3-4698-9a1a-fbfc09ab9524 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:19.934051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c5a66bee374a458adea27e3539bc6c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.944505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c5a66bee374a458adea27e3539bc6c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.945413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c5a66bee374a458adea27e3539bc6c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.946327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c5a66bee374a458adea27e3539bc6c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.963319 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1130/2263] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:19 2022] PUT /identity/v3/projects/8a4cb6e6c3394f16b3c26ab916b6c916/users/16dd9266446448ccbb30becb702abfa9/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:19.963319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd440-685f-4172-b933-164771326caf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:19.963319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd440-685f-4172-b933-164771326caf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:19.963761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd440-685f-4172-b933-164771326caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:19.972378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c5a66bee374a458adea27e3539bc6c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:19.994367 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1134/2264] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:19 2022] DELETE /identity/v3/users/05c5a66bee374a458adea27e3539bc6c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:19.998566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:20.000239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.009993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-112fd440-685f-4172-b933-164771326caf None None] MFA Rules not processed for user `16dd9266446448ccbb30becb702abfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:20.011223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-112fd440-685f-4172-b933-164771326caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.064966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b48ae-7ef5-422d-874f-f967d6d8c091 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:20.068770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:20.069382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.069686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.070055 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.071824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.092770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:20.100805 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1131/2265] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:20.101960 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.102506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.102506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.130343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:20.131556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.143615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:20.145155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:20.155239 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1135/2266] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:20.156090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:20.157758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.172898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb3baa-40ab-4920-aa66-12875c3f3cd4 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:20.179120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:20.180225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.180516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.180919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.193181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:20.194626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:20.202906 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1132/2267] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:20.205396 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1136/2268] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:20.220092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:20.222211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.331713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a576b-188a-4fda-8374-94526015f8ba None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:20.335575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:20.336248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.336530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.336811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.347235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:20.348762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:20.359573 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1133/2269] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:20.782577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:20.783849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:20.798753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400928-4de3-4836-bba4-be7d345748fa service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:20.803550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:20.804222 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.804636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.804907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] PATH_INFO: `/v3/projects/f64edaed9261417bbfe18f85bd21bef2` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.806074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64edaed9261417bbfe18f85bd21bef2)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:20.808174 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:20.855863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64edaed9261417bbfe18f85bd21bef2', 'request_id': 'req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:20.862043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64edaed9261417bbfe18f85bd21bef2', 'request_id': 'req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:20.868272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64edaed9261417bbfe18f85bd21bef2', 'request_id': 'req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:20.881999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] The token cache is being invalidate because project f64edaed9261417bbfe18f85bd21bef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:20.882290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:20.882907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:20.887492 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1137/2270] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:20 2022] DELETE /identity/v3/projects/f64edaed9261417bbfe18f85bd21bef2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:20.889195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:20.899049 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15334b-792f-44af-8428-a1b4fa95c8db service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:20.917154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:20.967423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:20.967423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:20.967423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:20.967423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] PATH_INFO: `/v3/users/c7838c69542145f8a4a87218ebe02c05` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:20.967745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7838c69542145f8a4a87218ebe02c05)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:20.968873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:21.018056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7838c69542145f8a4a87218ebe02c05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.025220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7838c69542145f8a4a87218ebe02c05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.025800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7838c69542145f8a4a87218ebe02c05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.034696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7838c69542145f8a4a87218ebe02c05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.052442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7838c69542145f8a4a87218ebe02c05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.059312 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1134/2271] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:20 2022] DELETE /identity/v3/users/c7838c69542145f8a4a87218ebe02c05 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:21.077877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:21.079330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:21.142323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5fa09-bb19-4c52-8136-c8b8f98e80d7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:21.185921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:21.197242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:21.197982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.198278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.198554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.200407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:21.265719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:21.268122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f11a5-d3b0-4147-91f7-70691b9fb696 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:21.279023 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1138/2272] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:21.364293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:21.366027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:21.455064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d182aa-5483-4e21-9edd-0536d46ec29e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:21.460328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:21.460993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.461308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.461530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] PATH_INFO: `/v3/projects/37f55635381242928e12ac552f6d0e0d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.462976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f55635381242928e12ac552f6d0e0d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:21.465227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:21.522791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:21.533402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f55635381242928e12ac552f6d0e0d', 'request_id': 'req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.541432 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f55635381242928e12ac552f6d0e0d', 'request_id': 'req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.554946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f55635381242928e12ac552f6d0e0d', 'request_id': 'req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.573564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] The token cache is being invalidate because project 37f55635381242928e12ac552f6d0e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:21.574006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.574843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-79ac41fc-139d-48ec-9b1f-bd02f9ec9dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:21.577950 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1135/2273] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:21 2022] DELETE /identity/v3/projects/37f55635381242928e12ac552f6d0e0d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:21.584612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.584907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.585247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.606728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:21.608185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:21.692556 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1139/2274] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:21.695591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.695877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.696260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.725610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:21.727143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:21.749134 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1136/2275] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:21.761057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:21.778119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de2392-2dc4-4505-bd20-cfc85dd69c9c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:21.783741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:21.784625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.785088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.785558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.786457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:21.787136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:21.789070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:21.806013 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1140/2276] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:21.812461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:21.830727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1315e-2701-424e-9b50-31c408b94c4c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:21.843064 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:21.845057 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:21.845448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:21.845825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:21.846697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:21.852122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:21.894261 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1137/2277] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:21 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:21.899386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:21.920543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c51d-ec93-4a56-8015-75333f00e6d5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.061734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.062446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.062676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.063461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.064385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.066621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.107668 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1141/2278] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:21 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:22.108620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:22.125691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1321a-c79f-445f-abe5-1ae6dbe765fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.133893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.134627 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.134982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.135325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.136137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.138155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.150408 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1138/2279] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:22.155201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:22.166757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555693a2-04e1-466a-a30c-73075a3eb6ba admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.169910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:22.171681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:22.174514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.175139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.175456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.175717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.176732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.179069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.193108 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1142/2280] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:22.197164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:22.203368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:22.209865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64530f3-ab0e-443c-ba5c-56d2e94dd50f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.218639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.219435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.219881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.220034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] PATH_INFO: `/v3/projects/0001dd85b7d8407798f76d0a66e88723/users/7c365049326e456a837eadc09c57a75e/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.238413 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0001dd85b7d8407798f76d0a66e88723, user_id=7c365049326e456a837eadc09c57a75e, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.241344 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa7e4b-494e-4fa4-ac80-45dd65603693 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.244401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1843f2-1cd7-442f-9136-1382d9b0c398 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.248494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.249271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.249669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.250017 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.253023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:22.255477 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1143/2281] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:22 2022] PUT /identity/v3/projects/0001dd85b7d8407798f76d0a66e88723/users/7c365049326e456a837eadc09c57a75e/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:22.260624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb3eb-ad3a-4597-845a-168e9909fa4f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.260923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb3eb-ad3a-4597-845a-168e9909fa4f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.261248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb3eb-ad3a-4597-845a-168e9909fa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.282607 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b48fb3eb-ad3a-4597-845a-168e9909fa4f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:22.283868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b48fb3eb-ad3a-4597-845a-168e9909fa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:22.327629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.329321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.340545 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1139/2282] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:22.353990 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1144/2283] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:22.363785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:22.365293 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:22.420761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:22.457909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7ee3-d1ce-405f-827a-8b2bd0756dba service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:22.529310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:22.530164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:22.530443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:22.530717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:22.542031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:22.543477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:22.553800 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1140/2284] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:23.551152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:23.551597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:23.551703 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:23.606407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] MFA Rules not processed for user `7c365049326e456a837eadc09c57a75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:23.608772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:23.780284 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1145/2285] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:23.787540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:23.853577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ba37d-b540-4931-b4a0-f3d2e9210535 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:23.857517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:23.858157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:23.858440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:23.858715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:23.875714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:23.877178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40572646-0d21-472c-9023-e227eca3cbfb service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:23.887947 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1141/2286] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:24.442004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:24.444298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:24.459490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50441691-d6ec-4c17-9d09-2581713dabdc None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:24.464162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:24.464808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:24.465097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:24.465376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] PATH_INFO: `/v3/users/6289b7eaf74440469f91b645ccc246c1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:24.466616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6289b7eaf74440469f91b645ccc246c1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:24.468528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:24.523039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6289b7eaf74440469f91b645ccc246c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:24.532599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6289b7eaf74440469f91b645ccc246c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:24.534653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6289b7eaf74440469f91b645ccc246c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:24.535505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6289b7eaf74440469f91b645ccc246c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:24.542771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:24.553278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6289b7eaf74440469f91b645ccc246c1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:24.569647 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1146/2287] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:24 2022] DELETE /identity/v3/users/6289b7eaf74440469f91b645ccc246c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:24.574270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:24.574592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:24.574839 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:24.597569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:24.598773 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:24.662666 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1142/2288] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:24.673676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:24.675108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:24.734675 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776eecc-d53f-4234-a3fd-8685b0dd5552 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:24.738371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:24.739011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:24.739296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:24.739567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:24.749533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:24.750953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:24.760397 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1147/2289] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:25.040508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:25.042594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:25.062533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae90763-92de-460e-841d-99dd6aff74ee None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:25.068933 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:25.069541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:25.070191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:25.070342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] PATH_INFO: `/v3/projects/f6acab6d5ed849c2bb49fc683f99455a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:25.071779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6acab6d5ed849c2bb49fc683f99455a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:25.073691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:25.117437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:25.128878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6acab6d5ed849c2bb49fc683f99455a', 'request_id': 'req-48d3ea77-01cc-455a-9120-60a57d2fcaf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.137831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6acab6d5ed849c2bb49fc683f99455a', 'request_id': 'req-48d3ea77-01cc-455a-9120-60a57d2fcaf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.148125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6acab6d5ed849c2bb49fc683f99455a', 'request_id': 'req-48d3ea77-01cc-455a-9120-60a57d2fcaf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.159692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] The token cache is being invalidate because project f6acab6d5ed849c2bb49fc683f99455a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:25.160055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.160893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48d3ea77-01cc-455a-9120-60a57d2fcaf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.162876 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1143/2290] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:25 2022] DELETE /identity/v3/projects/f6acab6d5ed849c2bb49fc683f99455a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:25.167769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:25.181506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2267214-6b27-45fb-8985-ea6f1daeda1a service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:25.274787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:25.275655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:25.276008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:25.276339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] PATH_INFO: `/v3/users/b836f986f8e54568926f29767d25ea9b` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:25.277571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b836f986f8e54568926f29767d25ea9b)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:25.280379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:25.352585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b836f986f8e54568926f29767d25ea9b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.353893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:25.354380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:25.354838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:25.378469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] MFA Rules not processed for user `7c365049326e456a837eadc09c57a75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:25.379698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:25.385505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b836f986f8e54568926f29767d25ea9b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.387631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b836f986f8e54568926f29767d25ea9b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.389000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b836f986f8e54568926f29767d25ea9b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.408874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b836f986f8e54568926f29767d25ea9b'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:25.437232 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1148/2291] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:25 2022] DELETE /identity/v3/users/b836f986f8e54568926f29767d25ea9b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:25.437232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:25.446444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:25.453476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:25.488021 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1144/2292] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:25.532660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cada65-62d6-44d1-9613-11c657a8570d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:25.537625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:25.538243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:25.538523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:25.538795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:25.540676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:25.625623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:25.628739 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:25.642421 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1149/2293] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:25.854704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:25.857984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:25.875748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13e53c-1aa6-4b96-9846-d685abb2dd4f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:25.951015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:25.951760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:25.952139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:25.952572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] PATH_INFO: `/v3/projects/6212102d25c344ebb2582d39ad98d67c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:25.953788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6212102d25c344ebb2582d39ad98d67c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:25.955995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:26.016562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6212102d25c344ebb2582d39ad98d67c', 'request_id': 'req-5c10be38-13ee-4644-b0ef-ae01f2c4250b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.025251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6212102d25c344ebb2582d39ad98d67c', 'request_id': 'req-5c10be38-13ee-4644-b0ef-ae01f2c4250b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.036531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6212102d25c344ebb2582d39ad98d67c', 'request_id': 'req-5c10be38-13ee-4644-b0ef-ae01f2c4250b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.049121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:26.056983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] The token cache is being invalidate because project 6212102d25c344ebb2582d39ad98d67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:26.057779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.058764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.064041 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1145/2294] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:25 2022] DELETE /identity/v3/projects/6212102d25c344ebb2582d39ad98d67c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:26.066881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:26.079572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf00c-f383-420e-b73c-91646f58e290 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:26.175706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:26.177114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:26.177382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:26.177889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] PATH_INFO: `/v3/users/d71fc0c9c4ca4dd78c72a77508eb2fb3` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:26.179107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71fc0c9c4ca4dd78c72a77508eb2fb3)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:26.181292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:26.244912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71fc0c9c4ca4dd78c72a77508eb2fb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.251543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:26.253840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71fc0c9c4ca4dd78c72a77508eb2fb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.255037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71fc0c9c4ca4dd78c72a77508eb2fb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.255152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71fc0c9c4ca4dd78c72a77508eb2fb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.276268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71fc0c9c4ca4dd78c72a77508eb2fb3'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.317160 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1150/2295] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:26 2022] DELETE /identity/v3/users/d71fc0c9c4ca4dd78c72a77508eb2fb3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:26.633312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:26.638062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:26.672810 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10be38-13ee-4644-b0ef-ae01f2c4250b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:26.764250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:26.764492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:26.764882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:26.765414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] PATH_INFO: `/v3/users/41a3d80f93a742ba9c1631062bbc07bb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:26.768039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a3d80f93a742ba9c1631062bbc07bb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:26.770087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:26.844237 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:26.845801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:26.855358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a3d80f93a742ba9c1631062bbc07bb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.864975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f5d7-7e0c-4394-899a-8cf024072844 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:26.865805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a3d80f93a742ba9c1631062bbc07bb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.866534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a3d80f93a742ba9c1631062bbc07bb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.871219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:26.872038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:26.873006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:26.873407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] PATH_INFO: `/v3/projects/c7f05233aac2499fb2197c94e1f7d085` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:26.876154 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f05233aac2499fb2197c94e1f7d085)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:26.879394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:26.881264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a3d80f93a742ba9c1631062bbc07bb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.898006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a403f2f4-9e0c-44ae-b657-35d7d8df60af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a3d80f93a742ba9c1631062bbc07bb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.906101 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1146/2296] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:26 2022] DELETE /identity/v3/users/41a3d80f93a742ba9c1631062bbc07bb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:26.910176 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:26.910568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:26.910950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:26.935965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:26.936651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f05233aac2499fb2197c94e1f7d085', 'request_id': 'req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.937571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:26.945258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f05233aac2499fb2197c94e1f7d085', 'request_id': 'req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.952744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f05233aac2499fb2197c94e1f7d085', 'request_id': 'req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.968248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] The token cache is being invalidate because project c7f05233aac2499fb2197c94e1f7d085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:26.968612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.969357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ccede3e-3f8a-4932-8b0c-91b8ce8332cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:26.971036 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1151/2297] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:26 2022] DELETE /identity/v3/projects/c7f05233aac2499fb2197c94e1f7d085 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:26.975657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d76d-14fb-40b3-9fb4-8c81fbf93ae6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:26.975968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d76d-14fb-40b3-9fb4-8c81fbf93ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:26.976261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d76d-14fb-40b3-9fb4-8c81fbf93ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:26.995879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a559d76d-14fb-40b3-9fb4-8c81fbf93ae6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:26.997133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a559d76d-14fb-40b3-9fb4-8c81fbf93ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.022467 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1147/2298] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:27.033680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.035453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.065732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:27.066343 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1152/2299] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:27.072699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d594f-7308-4b63-b667-95501525a750 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.072995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d594f-7308-4b63-b667-95501525a750 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.073280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d594f-7308-4b63-b667-95501525a750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.095572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-f95d594f-7308-4b63-b667-95501525a750 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:27.096844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-f95d594f-7308-4b63-b667-95501525a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.108484 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1153/2300] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:27.112821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d594f-7308-4b63-b667-95501525a750 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.113730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9d18-d6bd-4668-8483-d43eeef87dd9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.118386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.118635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.118983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.119374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.123428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d594f-7308-4b63-b667-95501525a750 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.128333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.129051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.129450 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.129764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.130581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.130685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:27.131199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.132318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.133037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.151848 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1154/2301] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:19:27.153005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.156155 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1148/2302] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:27.165235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e61af5-6b24-4549-82bb-a497c3fc259c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.170626 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.171242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.171556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.171965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.172528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.174639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.213466 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1155/2303] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:27 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:27.215623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.228450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098362e9-414a-481e-86a0-fab24e0acde6 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.302845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.303693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.304231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.304581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.305341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.307339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.337781 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1149/2304] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:27 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:27.338950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.350266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967e399-af17-40b1-80f0-bf602109aeb1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.354909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.355516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.355796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.356100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.356850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.358438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.368655 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1156/2305] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:27.373082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.383145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887a43b-8d97-4e4a-b797-251ad2eb45c5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.387838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.389300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.389457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.389705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.390409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.392036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed3d58-745d-4232-9a64-11db197139c9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.402169 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1150/2306] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:27.407607 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.413751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:27.420153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee292a7-96d8-4aa1-93b8-749ffbdd7f67 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.427324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.428231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.428691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.429108 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] PATH_INFO: `/v3/projects/71f4d508559e4c5eb9a2e2002407c482/users/589c2fa9ebd44f88915716f9d4250aa4/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.447816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f4d508559e4c5eb9a2e2002407c482, user_id=589c2fa9ebd44f88915716f9d4250aa4, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.451346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.476275 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1157/2307] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:27 2022] PUT /identity/v3/projects/71f4d508559e4c5eb9a2e2002407c482/users/589c2fa9ebd44f88915716f9d4250aa4/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:27.488398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.488685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.488961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.541286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] MFA Rules not processed for user `589c2fa9ebd44f88915716f9d4250aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:27.541879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.543993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.545650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.642404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59186709-45d8-4e94-8e1e-f8cc6a28ec7a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.654581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.655258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.655546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.655826 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] PATH_INFO: `/v3/users/16dd9266446448ccbb30becb702abfa9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.658866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dd9266446448ccbb30becb702abfa9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.663212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.685675 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1151/2308] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:27.686826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.688328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.732283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fd74-3b67-4c8e-8c2d-ab834933a027 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.733765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dd9266446448ccbb30becb702abfa9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.737775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.738315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.738601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.739450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] PATH_INFO: `/v3/projects/32fd676c702a4c11af46ede85aa54497` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.742462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fd676c702a4c11af46ede85aa54497)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.742609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dd9266446448ccbb30becb702abfa9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.742791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.743326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dd9266446448ccbb30becb702abfa9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.744052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dd9266446448ccbb30becb702abfa9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.761640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dd9266446448ccbb30becb702abfa9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.776965 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1158/2309] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:27 2022] DELETE /identity/v3/users/16dd9266446448ccbb30becb702abfa9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:27.780313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.780313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.781651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:27.803727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fd676c702a4c11af46ede85aa54497', 'request_id': 'req-c764b251-f94e-4e19-a75d-ea1792e7dae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.810356 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fd676c702a4c11af46ede85aa54497', 'request_id': 'req-c764b251-f94e-4e19-a75d-ea1792e7dae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.820109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fd676c702a4c11af46ede85aa54497', 'request_id': 'req-c764b251-f94e-4e19-a75d-ea1792e7dae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.834431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] The token cache is being invalidate because project 32fd676c702a4c11af46ede85aa54497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:27.834744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.835453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c764b251-f94e-4e19-a75d-ea1792e7dae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:27.837408 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1152/2310] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:27 2022] DELETE /identity/v3/projects/32fd676c702a4c11af46ede85aa54497 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:27.838623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.838914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.839200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.855466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02ab5-4990-48ef-b1b3-9a10f21f6d5a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.860328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:27.861567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.865562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:27.918405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.919665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.920188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.922430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.922430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.944937 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1153/2311] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:27.944937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:27.944937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:27.967395 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66dc7a-02b5-4a4f-86b4-4018ac4d2e4d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:27.973993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:27.975132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:27.975629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:27.976205 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] PATH_INFO: `/v3/users/7e6cf175271242c6a111a85969d027ad` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:27.977746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6cf175271242c6a111a85969d027ad)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.980314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:27.994364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:27.996283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:28.007755 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1159/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:28.008483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:28.009835 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:28.082490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6cf175271242c6a111a85969d027ad'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:28.087153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404eaa4-e611-4d7d-9575-44314f025fa6 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:28.093493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:28.094180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:28.094462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:28.094734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:28.096171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6cf175271242c6a111a85969d027ad'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:28.097170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6cf175271242c6a111a85969d027ad'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:28.108245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:28.109120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6cf175271242c6a111a85969d027ad'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:28.109807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:28.126295 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1160/2313] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:28.139682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6cf175271242c6a111a85969d027ad'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:28.151791 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1154/2314] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:27 2022] DELETE /identity/v3/users/7e6cf175271242c6a111a85969d027ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:29.054219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.075024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4fd51-573d-41ab-b2bc-a451c6ab6b28 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.116768 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.120147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:29.173722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:29.177804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.179223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.181940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.182286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] PATH_INFO: `/v3/projects/ec6824d288c54342b7000fff8549789f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.184302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6824d288c54342b7000fff8549789f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.187637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:29.212737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:29.235106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c309-955f-41fa-bf08-7cc4dd0a5ad0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.240579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.241472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.241760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.242763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] PATH_INFO: `/v3/projects/8a4cb6e6c3394f16b3c26ab916b6c916` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.244092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4cb6e6c3394f16b3c26ab916b6c916)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.246016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:29.261790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6824d288c54342b7000fff8549789f', 'request_id': 'req-2001f087-917e-4ee4-b32b-bfbc69d78f5c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.271196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6824d288c54342b7000fff8549789f', 'request_id': 'req-2001f087-917e-4ee4-b32b-bfbc69d78f5c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.277299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6824d288c54342b7000fff8549789f', 'request_id': 'req-2001f087-917e-4ee4-b32b-bfbc69d78f5c'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.291574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] The token cache is being invalidate because project ec6824d288c54342b7000fff8549789f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:29.291892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.292954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.294748 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1161/2315] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:29 2022] DELETE /identity/v3/projects/ec6824d288c54342b7000fff8549789f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:29.298565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.300103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:29.302996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4cb6e6c3394f16b3c26ab916b6c916', 'request_id': 'req-8c7f8b33-cbea-406a-a615-d19c582e9304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.312061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4cb6e6c3394f16b3c26ab916b6c916', 'request_id': 'req-8c7f8b33-cbea-406a-a615-d19c582e9304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.321252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4cb6e6c3394f16b3c26ab916b6c916', 'request_id': 'req-8c7f8b33-cbea-406a-a615-d19c582e9304'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.337234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] The token cache is being invalidate because project 8a4cb6e6c3394f16b3c26ab916b6c916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:29.337531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.339217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8c7f8b33-cbea-406a-a615-d19c582e9304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.341885 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1155/2316] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:29 2022] DELETE /identity/v3/projects/8a4cb6e6c3394f16b3c26ab916b6c916 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:29.346697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2f29-5152-43c2-8bed-15667f27c86d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.347058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2f29-5152-43c2-8bed-15667f27c86d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.347405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef2f29-5152-43c2-8bed-15667f27c86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.370571 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5bef2f29-5152-43c2-8bed-15667f27c86d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:29.371951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5bef2f29-5152-43c2-8bed-15667f27c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:29.374231 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001f087-917e-4ee4-b32b-bfbc69d78f5c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.460790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.461484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.461952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.462298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] PATH_INFO: `/v3/users/b5f11212c3f54c6d94b47a1cc5f599cf` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.464310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f11212c3f54c6d94b47a1cc5f599cf)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.464701 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1156/2317] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:29.469934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:29.477156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.477449 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.477728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.505170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:29.507145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:29.517915 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1157/2318] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:29.532759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.553027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854341-3c9e-4cab-809f-71be35b0b31c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.561658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f11212c3f54c6d94b47a1cc5f599cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.564969 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:29.565283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.567472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.567908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.568463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.569345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:29.569802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.575020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:29.581117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f11212c3f54c6d94b47a1cc5f599cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.582947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f11212c3f54c6d94b47a1cc5f599cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.583971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f11212c3f54c6d94b47a1cc5f599cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.597328 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1158/2319] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:29.603271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.612437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:29.637726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f11212c3f54c6d94b47a1cc5f599cf'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:29.642279 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4584-168c-44e3-b0fd-24742b00c04f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.653072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.654374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.654897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.655414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.656268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.659180 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:29.663813 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1162/2320] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:29 2022] DELETE /identity/v3/users/b5f11212c3f54c6d94b47a1cc5f599cf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:29.701997 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1159/2321] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:29 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:29.707146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:29.846617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0769d-ea4e-42bf-b9fd-273d192e30ce admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:29.976543 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:29.978408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:29.979149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:29.979917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:29.982464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:29.986556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.026279 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1163/2322] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:29 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:30.030567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.042967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dca8e-b664-422e-b011-d2f484319175 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.053138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.053472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.053851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.054193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.055546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.057566 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.080668 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1160/2323] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:30.084782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.105900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa72cc4-d1a7-4609-afba-cde5ccaf48d9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.122760 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.123600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.123706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.124168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.124168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.124873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.126138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.126476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.136093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:30.141169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ffb89-961a-4262-9e92-d9505743bc45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.152168 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1164/2324] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:30.157575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.171912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c854d1-859a-4d4f-a649-5fb8acff8b0b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.174188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.174888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.175269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.175901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] PATH_INFO: `/v3/projects/86fb640029ef4a98a21167fe7b4467b3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.177548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.178268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.178440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86fb640029ef4a98a21167fe7b4467b3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.178689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.179029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] PATH_INFO: `/v3/projects/d6a33b6e87ae4798b55e1d028efbb1ce/users/fde597a661c348f3ac3acf979a1b9994/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.184283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.197815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a33b6e87ae4798b55e1d028efbb1ce, user_id=fde597a661c348f3ac3acf979a1b9994, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.201851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80d10d-4211-4c5c-ba0d-7e2608fd26e4 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.224038 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1165/2325] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:30 2022] PUT /identity/v3/projects/d6a33b6e87ae4798b55e1d028efbb1ce/users/fde597a661c348f3ac3acf979a1b9994/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:30.231426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.232072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.232535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.262080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86fb640029ef4a98a21167fe7b4467b3', 'request_id': 'req-9930a39a-dba7-4947-89a0-3de7098f0b3f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:30.266386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] MFA Rules not processed for user `fde597a661c348f3ac3acf979a1b9994`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:30.267637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.269595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86fb640029ef4a98a21167fe7b4467b3', 'request_id': 'req-9930a39a-dba7-4947-89a0-3de7098f0b3f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:30.280148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86fb640029ef4a98a21167fe7b4467b3', 'request_id': 'req-9930a39a-dba7-4947-89a0-3de7098f0b3f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:30.290457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:30.298562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] The token cache is being invalidate because project 86fb640029ef4a98a21167fe7b4467b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:30.298862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:30.299549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9930a39a-dba7-4947-89a0-3de7098f0b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:30.318348 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1161/2326] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:30 2022] DELETE /identity/v3/projects/86fb640029ef4a98a21167fe7b4467b3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:30.326524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6bc7-8aa3-47a9-af3c-974a1f0be5ac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.328255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6bc7-8aa3-47a9-af3c-974a1f0be5ac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.328771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe6bc7-8aa3-47a9-af3c-974a1f0be5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.359784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8abe6bc7-8aa3-47a9-af3c-974a1f0be5ac None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:30.361105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8abe6bc7-8aa3-47a9-af3c-974a1f0be5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.390472 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1166/2327] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:30.406556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.408278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.453912 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1162/2328] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:30.461879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.462175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.462452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.483183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5ee7-2c57-4c96-80b4-1a44acdd6f2b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.487818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:30.489239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.489818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.490740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.491240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.491784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.501217 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1163/2329] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:30.505457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.506038 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.507461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.519275 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1167/2330] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:30.521682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa0b95-9c46-4470-971e-179c77d347ba None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.530717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.531734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.531734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.531909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.533143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:30.533469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.535067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.551982 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1164/2331] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:30.554291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.568396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29fbba-cf8a-43d5-890e-4fcb36bfab78 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.575391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.576753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.577107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.577479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.578224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.580642 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.617806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1168/2332] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:30 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:30.623111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.635006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3c6cd-af23-4bee-8fea-88f5978dfed2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.780654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.781403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.781783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.782247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.783178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.791510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.819926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:30.833233 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1165/2333] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:30 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:30.836009 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.856529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f948c2c-410a-4281-94db-58eac8b663c6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.880396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.881528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.881831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.882466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.883952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.899090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.929512 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1169/2334] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:30.933335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.958251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:30.961156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:30.965988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df2e83-e559-403d-b111-504932461c2c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.977963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f1baa-0fc3-4a84-92b1-dd468f86e5c5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:30.982744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.984091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:30.985067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.985192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:30.985602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.986027 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] PATH_INFO: `/v3/users/589c2fa9ebd44f88915716f9d4250aa4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.986366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:30.986757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:30.988303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589c2fa9ebd44f88915716f9d4250aa4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.989556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:30.990740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:30.993386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:31.022236 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1166/2335] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:31.029692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:31.055763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be2324-1b77-405f-b223-ea9092616b3c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:31.066198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:31.067016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:31.067370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:31.068397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] PATH_INFO: `/v3/projects/e7453e77c873488bb24d66bdb9766282/users/a093f8303fb4485c9da4b7c4d9a64711/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:31.076121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589c2fa9ebd44f88915716f9d4250aa4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:31.110017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589c2fa9ebd44f88915716f9d4250aa4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:31.110800 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589c2fa9ebd44f88915716f9d4250aa4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:31.111733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589c2fa9ebd44f88915716f9d4250aa4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:31.112231 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7453e77c873488bb24d66bdb9766282, user_id=a093f8303fb4485c9da4b7c4d9a64711, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:31.117261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cf7c1-94b8-4aa1-945b-cbbe34dd36c4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:31.148314 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1167/2336] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:31 2022] PUT /identity/v3/projects/e7453e77c873488bb24d66bdb9766282/users/a093f8303fb4485c9da4b7c4d9a64711/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:31.148981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c39c4b32-4d47-46ba-90fa-6d2593de8f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589c2fa9ebd44f88915716f9d4250aa4'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:31.150865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:31.151190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:31.151584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:31.161654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:31.180282 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1170/2337] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:30 2022] DELETE /identity/v3/users/589c2fa9ebd44f88915716f9d4250aa4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:31.181964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:31.182448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:31.182875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:31.205788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] MFA Rules not processed for user `a093f8303fb4485c9da4b7c4d9a64711`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:31.207163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:31.208334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:31.209871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:31.305480 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1171/2338] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:31.321282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:31.323606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:31.342156 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1168/2339] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:31.353565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:31.357067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:31.457091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9bad2-ff02-4252-b12a-0f669085b655 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:31.462236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:31.463063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:31.463351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:31.463631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:31.476303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368e46d-6bc1-4a9c-8c4d-8f7ed5cfe704 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:31.478704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:31.479873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:31.484445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:31.485149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:31.485562 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:31.485992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:31.510525 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1169/2340] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:19:31.513736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:31.518301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9a292-8823-4545-a75e-d827f75be1da service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:31.549237 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1172/2341] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:32.392794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:32.394818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:32.417130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3245f-d0c7-44dd-b376-703ecd1fd94b service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:32.448673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:32.452718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:32.453072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:32.453355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] PATH_INFO: `/v3/projects/71f4d508559e4c5eb9a2e2002407c482` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:32.462418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f4d508559e4c5eb9a2e2002407c482)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:32.480675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:32.576553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f4d508559e4c5eb9a2e2002407c482', 'request_id': 'req-99e524c5-95ce-4a6d-bbe3-69144388b3fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:32.577868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:32.592466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f4d508559e4c5eb9a2e2002407c482', 'request_id': 'req-99e524c5-95ce-4a6d-bbe3-69144388b3fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:32.624439 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f4d508559e4c5eb9a2e2002407c482', 'request_id': 'req-99e524c5-95ce-4a6d-bbe3-69144388b3fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:32.657295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] The token cache is being invalidate because project 71f4d508559e4c5eb9a2e2002407c482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:32.662364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:32.663290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-99e524c5-95ce-4a6d-bbe3-69144388b3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:32.667113 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1170/2342] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:32 2022] DELETE /identity/v3/projects/71f4d508559e4c5eb9a2e2002407c482 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:32.673658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:32.674502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:32.674968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:32.715803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:32.725236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:32.921175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1794ce9-58bc-48a9-890b-ca4d927a1fb3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:32.921175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1794ce9-58bc-48a9-890b-ca4d927a1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:32.921175 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1794ce9-58bc-48a9-890b-ca4d927a1fb3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:32.921175 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1171/2343] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:19:32.935486 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1173/2344] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:32.951466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b58c-be46-4317-870c-d1a709f5d0c1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:32.951466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b58c-be46-4317-870c-d1a709f5d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:32.951466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b58c-be46-4317-870c-d1a709f5d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:32.990392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e9a6b58c-be46-4317-870c-d1a709f5d0c1 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:32.995984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e9a6b58c-be46-4317-870c-d1a709f5d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.018422 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1172/2345] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:33.021342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.037788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3cf6c-ece3-4d87-9ba9-139a8963c042 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.045242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.045890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.046177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.046461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.048095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:33.048555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.051007 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.069034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.069283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.069451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.082921 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1174/2346] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:33.100612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.114729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414217f-34e0-4278-81ce-fb9dbf59527a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.116417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] MFA Rules not processed for user `fcf777bc227f4dca8be60a22026d1b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:33.120253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.121766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.123508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.123816 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.124186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.124876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.126962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febee23-5b74-40b8-8225-b8d8c56faff1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.166058 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1175/2347] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:33 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:33.167286 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.167647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.167917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.206390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] MFA Rules not processed for user `a093f8303fb4485c9da4b7c4d9a64711`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:33.208512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.217302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:33.296457 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1173/2348] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:33.299078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.307461 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1176/2349] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:33.308441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.310810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.334102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ba219-b2b2-4f43-b57b-907fd5332d83 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.416600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cfc6-45d8-4683-bb48-2ba12b70a5d6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.422168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.422934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.423323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.423700 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] PATH_INFO: `/v3/users/bd896e56eee346018faf5c4e09f47c1d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.425128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd896e56eee346018faf5c4e09f47c1d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.427330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.439897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.444532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.444935 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.445318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.446233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.448334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.473434 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1174/2350] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:33 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:33.476023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.476458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.492538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd896e56eee346018faf5c4e09f47c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:33.503780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd896e56eee346018faf5c4e09f47c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:33.504627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd896e56eee346018faf5c4e09f47c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:33.505384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd896e56eee346018faf5c4e09f47c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:33.520917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd896e56eee346018faf5c4e09f47c1d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:33.537255 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1177/2351] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:33 2022] DELETE /identity/v3/users/bd896e56eee346018faf5c4e09f47c1d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:33.541087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:33.549977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.558106 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.562335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402aef3a-8d1e-46b1-9f74-066f7f19a517 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.616493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:33.657654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.658487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.658789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.659186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.663708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.666454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba44aa-819e-4acd-a01f-7ab9b097bd6e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.674032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.674795 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.676071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.676423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.677151 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.679157 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.681318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.683523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.699876 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1175/2353] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:33.700104 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1178/2353] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:33.701271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.716577 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048e11-d72d-4513-a501-b3503f9e601a service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.723099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.724199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.724583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.724998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.725752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.727805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.740416 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1176/2354] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:33.745302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.757554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a95eab-50ba-405b-819f-baf2cfb76d17 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.764521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.765474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.766196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.766323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] PATH_INFO: `/v3/projects/583b1a8112f84c96ae0cf177a71e78dc/users/1d89c07af7d74df59b6c79912b42ee87/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.790625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583b1a8112f84c96ae0cf177a71e78dc, user_id=1d89c07af7d74df59b6c79912b42ee87, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.796633 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.798542 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.802425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef1162-f15a-46f1-8854-569999892b65 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.813333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257a857-910a-4756-9ee9-e99662b18327 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:33.832510 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1179/2355] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:33 2022] PUT /identity/v3/projects/583b1a8112f84c96ae0cf177a71e78dc/users/1d89c07af7d74df59b6c79912b42ee87/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:33.835864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.836263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.836620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.868363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] MFA Rules not processed for user `1d89c07af7d74df59b6c79912b42ee87`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:33.869684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.883032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:33.883712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:33.884075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:33.884393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] PATH_INFO: `/v3/projects/e4bee49d1a674f60b62a4dd0c80c1866` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:33.885636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4bee49d1a674f60b62a4dd0c80c1866)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:33.887545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:33.950870 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1180/2356] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:33.972153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:33.984855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:33.993199 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4bee49d1a674f60b62a4dd0c80c1866', 'request_id': 'req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.031423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4bee49d1a674f60b62a4dd0c80c1866', 'request_id': 'req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.054765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4bee49d1a674f60b62a4dd0c80c1866', 'request_id': 'req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.070012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0e31-70b6-4a16-b461-84c8ac87666b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.070267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] The token cache is being invalidate because project e4bee49d1a674f60b62a4dd0c80c1866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:34.070830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.071728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6487cae0-98fd-4fd0-a1d4-4e77bacc08d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.073639 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1177/2357] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:33 2022] DELETE /identity/v3/projects/e4bee49d1a674f60b62a4dd0c80c1866 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:34.078281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafd75b-5b46-437e-99ab-c6d0eb948a1c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.078463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafd75b-5b46-437e-99ab-c6d0eb948a1c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.078747 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafd75b-5b46-437e-99ab-c6d0eb948a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.099965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-acafd75b-5b46-437e-99ab-c6d0eb948a1c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:34.101375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acafd75b-5b46-437e-99ab-c6d0eb948a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.106927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:34.147591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.148761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.149050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.149326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.151495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.159253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:34.196279 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1178/2358] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:34.204643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.204937 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.205218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.244915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:34.246151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.264216 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1179/2359] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:34.265515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.268436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.270221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.277240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7c72-d112-4b38-9b43-209e8431a78b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.288221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.288983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.289442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.289990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.290833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:34.291886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.294238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.305320 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1181/2360] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:34.317343 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1180/2361] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:34.321195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.334880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b196749-a050-4ae2-823b-a035da177da4 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.341553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.342902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.343442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.343946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.345143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.347386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.404469 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1182/2362] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:34.408865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.421749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd3731-390d-4753-a9ad-8ffc21e92475 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.473801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.475681 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.541460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.542162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.542491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.542779 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.543521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.547561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.585003 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1181/2363] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:34.589121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.594678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654487d0-9f68-463b-8d7d-3ca95c01ffe5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.599866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.600589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.600928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.601212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] PATH_INFO: `/v3/users/fde597a661c348f3ac3acf979a1b9994` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.602867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde597a661c348f3ac3acf979a1b9994)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.602973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b82927-09e0-45e1-afe5-c5fb308a9c85 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.604435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.611240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.611876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.613546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.614248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.615327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.619444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.635261 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1182/2364] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:34.640203 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.655700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15c73f-0771-4eca-8a6e-abd314699be8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.662365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.662921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.663342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.663623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.664760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.666792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.673194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde597a661c348f3ac3acf979a1b9994'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.680305 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1183/2365] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:34.684456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.685464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde597a661c348f3ac3acf979a1b9994'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.686448 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde597a661c348f3ac3acf979a1b9994'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.687177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde597a661c348f3ac3acf979a1b9994'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.698189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc998-0869-4ffb-9f5a-987488a0b793 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.701573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-d4246121-ccd6-446e-a0cb-89478c786a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde597a661c348f3ac3acf979a1b9994'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:34.706639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.708146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.708587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.709022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] PATH_INFO: `/v3/projects/e167fa3c551f447fb495f25d1aed741d/users/f572af904d55419bb237899e3a3c8e8d/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.718569 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1183/2366] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:34 2022] DELETE /identity/v3/users/fde597a661c348f3ac3acf979a1b9994 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:34.723238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.723485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.723763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.731294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e167fa3c551f447fb495f25d1aed741d, user_id=f572af904d55419bb237899e3a3c8e8d, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:34.735151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c94f74-38ca-4352-a396-e8db9884b06c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:34.742940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:34.751288 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1184/2367] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:34 2022] PUT /identity/v3/projects/e167fa3c551f447fb495f25d1aed741d/users/f572af904d55419bb237899e3a3c8e8d/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:34.756859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.757254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.757645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:34.768075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:34.769319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.784707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:34.786442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.828594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:34.863285 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1184/2368] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:34.889847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.893651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.906202 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1185/2369] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:34.916131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:34.918307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:34.986663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5732fde-b673-425b-846c-fc6e61c4e8bb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:34.990572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:34.991194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:34.991480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:34.991757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:35.004845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:35.006307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:35.014596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ae7f8-df3b-4748-a9ef-fb806211ff7d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:35.019237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:35.019336 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1185/2370] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:35.019916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:35.020194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:35.020383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:35.032345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:35.033540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101f14-2257-4863-8cea-39265045ac64 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:35.050113 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1186/2371] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:35.466587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:35.468434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:35.486295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b2bbc-e565-4791-8c2d-e739333aa438 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:35.492819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:35.493480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:35.493754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:35.494021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] PATH_INFO: `/v3/projects/d6a33b6e87ae4798b55e1d028efbb1ce` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:35.495812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a33b6e87ae4798b55e1d028efbb1ce)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:35.498782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:35.552639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a33b6e87ae4798b55e1d028efbb1ce', 'request_id': 'req-08933098-2bc3-43ab-a376-11d2d3e4be5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:35.559578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a33b6e87ae4798b55e1d028efbb1ce', 'request_id': 'req-08933098-2bc3-43ab-a376-11d2d3e4be5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:35.567071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a33b6e87ae4798b55e1d028efbb1ce', 'request_id': 'req-08933098-2bc3-43ab-a376-11d2d3e4be5a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:35.586962 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] The token cache is being invalidate because project d6a33b6e87ae4798b55e1d028efbb1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:35.587295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:35.588273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-08933098-2bc3-43ab-a376-11d2d3e4be5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:35.596052 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1186/2372] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:35 2022] DELETE /identity/v3/projects/d6a33b6e87ae4798b55e1d028efbb1ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:41.009758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.010177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.010344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.063558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] MFA Rules not processed for user `f572af904d55419bb237899e3a3c8e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:41.065993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:41.163766 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1187/2373] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:41.176040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c6d9-c463-4edb-b08a-ce3fd788f9cc None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.176614 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c6d9-c463-4edb-b08a-ce3fd788f9cc None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.176614 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514c6d9-c463-4edb-b08a-ce3fd788f9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.198366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0514c6d9-c463-4edb-b08a-ce3fd788f9cc None None] MFA Rules not processed for user `f572af904d55419bb237899e3a3c8e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:41.199526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0514c6d9-c463-4edb-b08a-ce3fd788f9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:41.207732 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1187/2374] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:41.222837 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:41.225278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:41.369351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:41.375576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31545e98-5512-4f73-8b0c-a4036e9ce7b9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:41.384123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81963e02-a680-493c-b83a-69563631643f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:41.384123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963e02-a680-493c-b83a-69563631643f service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:41.384123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963e02-a680-493c-b83a-69563631643f service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:41.384123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81963e02-a680-493c-b83a-69563631643f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:41.393872 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81963e02-a680-493c-b83a-69563631643f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:41.395530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81963e02-a680-493c-b83a-69563631643f service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:41.414038 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1188/2375] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:42.319853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70fe8-1c18-45ad-9b8d-cf7ab2e042c1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:42.320386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70fe8-1c18-45ad-9b8d-cf7ab2e042c1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:42.320483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad70fe8-1c18-45ad-9b8d-cf7ab2e042c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:42.355959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bad70fe8-1c18-45ad-9b8d-cf7ab2e042c1 None None] MFA Rules not processed for user `f572af904d55419bb237899e3a3c8e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:42.361363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bad70fe8-1c18-45ad-9b8d-cf7ab2e042c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:42.376727 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1188/2376] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:46.509323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81963e02-a680-493c-b83a-69563631643f service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:46.512868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81963e02-a680-493c-b83a-69563631643f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:46.659259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81963e02-a680-493c-b83a-69563631643f service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:46.668337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:46.670154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:46.670313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:46.670595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] PATH_INFO: `/v3/users/1d89c07af7d74df59b6c79912b42ee87` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:46.671974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d89c07af7d74df59b6c79912b42ee87)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:46.674019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:46.752101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d89c07af7d74df59b6c79912b42ee87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:46.771848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d89c07af7d74df59b6c79912b42ee87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:46.772733 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d89c07af7d74df59b6c79912b42ee87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:46.785303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d89c07af7d74df59b6c79912b42ee87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:46.826540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d89c07af7d74df59b6c79912b42ee87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:46.847501 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1189/2377] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:46 2022] DELETE /identity/v3/users/1d89c07af7d74df59b6c79912b42ee87 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:46.849341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:46.849784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:46.850971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:46.936132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:46.941296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:46.955763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:47.045014 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1189/2378] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:47.055343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:47.056914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:47.170429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a7e7-99ec-4683-9b81-6cf191b1ba9f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:47.182611 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:47.185632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:47.186153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:47.186622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:47.210318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:47.211871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9db9b-c56c-4545-ab6f-8a809fc72678 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:47.233769 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1190/2379] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:48.217682 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.220277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:48.238935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbf08a-5654-4f97-982e-bdf14bd28c4f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.248470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.249809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.250283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.250716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] PATH_INFO: `/v3/projects/583b1a8112f84c96ae0cf177a71e78dc` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.252728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583b1a8112f84c96ae0cf177a71e78dc)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.255463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.364563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583b1a8112f84c96ae0cf177a71e78dc', 'request_id': 'req-bfba9af7-8cf2-4742-86a0-6a82fe68a053'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.375307 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583b1a8112f84c96ae0cf177a71e78dc', 'request_id': 'req-bfba9af7-8cf2-4742-86a0-6a82fe68a053'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.385488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583b1a8112f84c96ae0cf177a71e78dc', 'request_id': 'req-bfba9af7-8cf2-4742-86a0-6a82fe68a053'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.406490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] The token cache is being invalidate because project 583b1a8112f84c96ae0cf177a71e78dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:48.406887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.409190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bfba9af7-8cf2-4742-86a0-6a82fe68a053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:48.410860 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1190/2380] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:48 2022] DELETE /identity/v3/projects/583b1a8112f84c96ae0cf177a71e78dc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:48.415922 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.416438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.416620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.436454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:48.437666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:48.447126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:48.506497 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1191/2381] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:48.515047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.515338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.515619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.536288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:48.537505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:48.545715 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1191/2382] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:48.550148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.566761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef926f-46e4-4baf-87d9-ef5693b69a83 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.571471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.572134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.572422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.572703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.573405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:48.573715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.575877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.588302 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1192/2383] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:48.593290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.603239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d655-b6a6-4af4-91d5-89cbd958932b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.608914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.609527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.609808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.610415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.611085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.613036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.642203 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1192/2384] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:48.647040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.659359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412509b9-17a3-4c53-9f17-c48ac0b06b56 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.726482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.727324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.727608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.727888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.728582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.730503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.766999 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1193/2385] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:19:48.771585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.786393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696370a9-f525-4dd9-8e78-2bdc66432517 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.798811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.799985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.800473 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.800821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.801606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.803845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.818502 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1193/2386] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:48.819382 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.831344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eb303-6a2a-4cfb-960a-b7790ae9eeb3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.836255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.837025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.837308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.837584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.838294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.839993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423504eb-8c41-47b9-aae8-3ec6494edfa3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.852434 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1194/2387] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:48.857090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:48.870165 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6967-3589-47d6-9c1f-2bf0c337354e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:48.875874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:48.876594 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.877143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.877518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] PATH_INFO: `/v3/projects/f13db2d3708d48e4b7b7b0a85f657408/users/14c2d6ad4dfb4db0a600e41cbc142de4/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.894319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13db2d3708d48e4b7b7b0a85f657408, user_id=14c2d6ad4dfb4db0a600e41cbc142de4, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:48.897128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:48.914038 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1194/2388] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:48 2022] PUT /identity/v3/projects/f13db2d3708d48e4b7b7b0a85f657408/users/14c2d6ad4dfb4db0a600e41cbc142de4/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:48.926495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:48.926799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:48.927068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:48.963037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] MFA Rules not processed for user `14c2d6ad4dfb4db0a600e41cbc142de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:48.964485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:49.048081 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1195/2389] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:19:49.056511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:49.058285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:49.107445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:49.128348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479165cc-2c9d-4b17-8cb3-617d428ce5fc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:49.132518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:49.133155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:49.133444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:49.133722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:49.143606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:49.145083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:49.155828 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1195/2390] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:49.929996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:49.931623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:49.944663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:50.002557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b127f55-d960-48c9-8708-a8ab02e8d40b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:50.007131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:50.007825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:50.008126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:50.008398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] PATH_INFO: `/v3/users/49c57f94b3b340b08022c6b8a17b209f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:50.009551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c57f94b3b340b08022c6b8a17b209f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:50.011475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:50.057357 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c57f94b3b340b08022c6b8a17b209f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.065716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c57f94b3b340b08022c6b8a17b209f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.066319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c57f94b3b340b08022c6b8a17b209f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.073275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c57f94b3b340b08022c6b8a17b209f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.085971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c57f94b3b340b08022c6b8a17b209f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.091926 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1196/2391] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:49 2022] DELETE /identity/v3/users/49c57f94b3b340b08022c6b8a17b209f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:50.269852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:50.282334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ea0cc-f960-4aa8-a6e7-9fb55ce4ce5e service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:50.346333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:50.347001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:50.347292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:50.347708 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] PATH_INFO: `/v3/projects/68109e62560047efb26dff354a681a10` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:50.349048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68109e62560047efb26dff354a681a10)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:50.351085 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:50.398439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68109e62560047efb26dff354a681a10', 'request_id': 'req-3b99964d-c31e-4af9-96dc-22fb7d7149e2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.405486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68109e62560047efb26dff354a681a10', 'request_id': 'req-3b99964d-c31e-4af9-96dc-22fb7d7149e2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.411829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68109e62560047efb26dff354a681a10', 'request_id': 'req-3b99964d-c31e-4af9-96dc-22fb7d7149e2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.426321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] The token cache is being invalidate because project 68109e62560047efb26dff354a681a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:50.426784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.439253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.441777 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1196/2392] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:50 2022] DELETE /identity/v3/projects/68109e62560047efb26dff354a681a10 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:50.445760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:50.447234 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:50.467622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49f13e-bc41-4844-998a-8521aa187f2b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:50.580819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:50.582619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:50.582619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:50.582619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] PATH_INFO: `/v3/users/ba3e0465b45746eabb724a6cfe4274fc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:50.588843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3e0465b45746eabb724a6cfe4274fc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:50.596315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:50.646751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:50.670556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3e0465b45746eabb724a6cfe4274fc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.682981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3e0465b45746eabb724a6cfe4274fc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.684827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3e0465b45746eabb724a6cfe4274fc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.695229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3e0465b45746eabb724a6cfe4274fc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.710738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-636a7ae8-0b2f-4989-84d8-3afa85cda8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3e0465b45746eabb724a6cfe4274fc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:50.719259 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1197/2393] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:50 2022] DELETE /identity/v3/users/ba3e0465b45746eabb724a6cfe4274fc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:51.609462 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:51.611012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:51.637672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99964d-c31e-4af9-96dc-22fb7d7149e2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:51.728197 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:51.728861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:51.729143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:51.729420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] PATH_INFO: `/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:51.730601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bd8cf431f744b7b2e85e3a4829456a)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:51.733949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:51.746887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:51.799198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bd8cf431f744b7b2e85e3a4829456a', 'request_id': 'req-8f80db7e-2053-4550-8062-6da613637cb8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:51.805750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bd8cf431f744b7b2e85e3a4829456a', 'request_id': 'req-8f80db7e-2053-4550-8062-6da613637cb8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:51.811623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bd8cf431f744b7b2e85e3a4829456a', 'request_id': 'req-8f80db7e-2053-4550-8062-6da613637cb8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:51.827786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] The token cache is being invalidate because project e6bd8cf431f744b7b2e85e3a4829456a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:51.828257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:51.828971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-8f80db7e-2053-4550-8062-6da613637cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:51.831359 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1197/2394] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:51 2022] DELETE /identity/v3/projects/e6bd8cf431f744b7b2e85e3a4829456a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:51.835986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:51.836460 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:51.836550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:51.858204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:51.859408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:51.936931 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1198/2395] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:51.944942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:51.945300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:51.945639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:51.966768 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:51.968045 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:51.976105 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1198/2396] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:51.980576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:51.991447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f100c3-fe0c-4d64-8439-e6763a9737dd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:51.996112 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:51.997346 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:51.997646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:51.997893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:51.998574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:19:51.998874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.000479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.012872 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1199/2397] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:19:52.017148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.026424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f63a06-6955-4e12-9880-6a9d25ff7653 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.031759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.032483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.032766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.033043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.033710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.035611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.065666 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1199/2398] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:19:52 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:52.069596 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.081226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f479-64a1-437e-b66a-7951ae10d3ae admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.142469 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.143100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.143483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.143764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.144483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.146409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.175604 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1200/2399] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:19:52 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:19:52.176086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.187511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6782325-71df-4e3d-be0d-d2ebdfadfd0d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.192746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.193364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.193646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.193922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.194706 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.196693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.212303 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1200/2400] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:19:52.216182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.226450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91a216-3320-4c87-9c82-d850b8e0b172 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.231780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.232409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.232690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.232962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.233652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.235228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79a6ac-6a61-41a7-beb5-f942de4ee370 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.245903 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1201/2401] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:19:52.251169 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.261439 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30011-3942-4957-9f3a-7ec108551ece admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.266269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.266917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.267194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.267466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] PATH_INFO: `/v3/projects/6c69a07f0bef41879ab36a9408b648e9/users/fa8fa852a30441069ebebc6f2380caba/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.282747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c69a07f0bef41879ab36a9408b648e9, user_id=fa8fa852a30441069ebebc6f2380caba, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.285500 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.298864 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1201/2402] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:19:52 2022] PUT /identity/v3/projects/6c69a07f0bef41879ab36a9408b648e9/users/fa8fa852a30441069ebebc6f2380caba/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:52.309196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.309626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.309906 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.335190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:52.339996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] MFA Rules not processed for user `fa8fa852a30441069ebebc6f2380caba`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:52.342753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:52.406960 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1202/2403] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:52.418921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:52.420719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:52.479971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b3ee1-7a0c-441f-b823-efd744d256af admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:52.484357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:52.484979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:52.485267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:52.485545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:52.493934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:52.495371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7314d8-9cc4-4014-871c-67b21033ae09 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:52.504580 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1202/2404] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:54.361212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:54.362742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.442741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d03a3-1d55-45ef-804b-29e98fc44866 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:54.447624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:54.448724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.448724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.448932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] PATH_INFO: `/v3/users/14c2d6ad4dfb4db0a600e41cbc142de4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.450654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c2d6ad4dfb4db0a600e41cbc142de4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:54.452670 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:54.499682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c2d6ad4dfb4db0a600e41cbc142de4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.506851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c2d6ad4dfb4db0a600e41cbc142de4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.507476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c2d6ad4dfb4db0a600e41cbc142de4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.515076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c2d6ad4dfb4db0a600e41cbc142de4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.527073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c2d6ad4dfb4db0a600e41cbc142de4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:54.533792 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1203/2405] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:19:54 2022] DELETE /identity/v3/users/14c2d6ad4dfb4db0a600e41cbc142de4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:19:54.538351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.538814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.538904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.557945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:54.559879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.592919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:54.620432 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1203/2406] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:19:54.630884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:54.632406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:54.660004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:19:54.693602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710eb13-ae1f-4741-afc2-f610bc85b53c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:54.697421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:54.698047 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:54.698331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:54.698610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:54.708772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:54.710222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2607-6541-4297-9188-9b9b1e616b79 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:54.720485 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1204/2407] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:19:54.987282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:19:54.988737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:55.008023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b20df-8041-4093-9bb1-a7bd5095b876 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:19:55.019346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:19:55.020102 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:55.020386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:55.020659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] PATH_INFO: `/v3/projects/f13db2d3708d48e4b7b7b0a85f657408` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:55.021952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13db2d3708d48e4b7b7b0a85f657408)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:19:55.023870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:19:55.073729 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13db2d3708d48e4b7b7b0a85f657408', 'request_id': 'req-b4e88842-000a-4fa6-a3de-5617e3d1dccb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.080219 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13db2d3708d48e4b7b7b0a85f657408', 'request_id': 'req-b4e88842-000a-4fa6-a3de-5617e3d1dccb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.086047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13db2d3708d48e4b7b7b0a85f657408', 'request_id': 'req-b4e88842-000a-4fa6-a3de-5617e3d1dccb'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.098497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] The token cache is being invalidate because project f13db2d3708d48e4b7b7b0a85f657408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:19:55.098788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.099404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b4e88842-000a-4fa6-a3de-5617e3d1dccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:19:55.100948 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1204/2408] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:19:54 2022] DELETE /identity/v3/projects/f13db2d3708d48e4b7b7b0a85f657408 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:19:56.405475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:19:56.405882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:19:56.406033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:19:56.446000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] MFA Rules not processed for user `7c365049326e456a837eadc09c57a75e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:19:56.447252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:19:56.517182 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1205/2409] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:01.250797 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f5aa-e659-4030-a6af-f351afe359f7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:01.251311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f5aa-e659-4030-a6af-f351afe359f7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:01.251405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f5aa-e659-4030-a6af-f351afe359f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:01.271403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-acd8f5aa-e659-4030-a6af-f351afe359f7 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:01.272656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-acd8f5aa-e659-4030-a6af-f351afe359f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:01.345908 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1205/2410] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:20:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:01.392467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:01.393914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:01.506458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9aafd-d4d2-43e1-9a92-bd703af5d839 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:01.511873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:01.512525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:01.512809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:01.513736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:01.524429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:01.526911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:01.537397 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1206/2411] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:02.202951 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ec7-b574-4212-8d2b-07586c37ea94 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.203239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ec7-b574-4212-8d2b-07586c37ea94 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.203573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2ec7-b574-4212-8d2b-07586c37ea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.239553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bade2ec7-b574-4212-8d2b-07586c37ea94 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:02.241053 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bade2ec7-b574-4212-8d2b-07586c37ea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:02.261818 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1206/2412] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:02.275841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:02.290190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959da0f-3a39-4a00-a4c0-46dac0d8c463 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:02.295911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:02.296562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.296844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.297119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.305993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:02.307655 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:02.317383 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1207/2413] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:02.581722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127db71-9b77-4e95-a8e6-0d732783bf27 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.582017 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127db71-9b77-4e95-a8e6-0d732783bf27 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.582299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127db71-9b77-4e95-a8e6-0d732783bf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.602788 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c127db71-9b77-4e95-a8e6-0d732783bf27 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:02.604034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c127db71-9b77-4e95-a8e6-0d732783bf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:02.612012 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1207/2414] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:20:02.624261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:02.634996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c606979-4ea5-4cba-8651-93326d9c57e9 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:02.641077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:02.641803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:02.641950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:02.642227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:02.650423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:02.652018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:02.661099 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1208/2415] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:03.054377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.054677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.054970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.073796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:03.075002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:03.083057 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1208/2416] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:03.097121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:03.108462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0b7a7-7400-4d94-8041-6ef57e0eaea1 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:03.113437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:03.114044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:03.114328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:03.114607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:03.122731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:03.124349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b602e-7fe5-4d29-b58b-c6d3e8b33755 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:03.132475 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1209/2417] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:05.542104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:05.543561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:05.598900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:05.622244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ea26d-a086-4c86-96f0-8be88f40831b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:05.627907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:05.628596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:05.628881 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:05.629191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] PATH_INFO: `/v3/users/a093f8303fb4485c9da4b7c4d9a64711` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:05.630496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a093f8303fb4485c9da4b7c4d9a64711)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:05.632530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:05.682864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a093f8303fb4485c9da4b7c4d9a64711'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:05.691352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a093f8303fb4485c9da4b7c4d9a64711'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:05.692121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a093f8303fb4485c9da4b7c4d9a64711'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:05.692735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a093f8303fb4485c9da4b7c4d9a64711'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:05.705849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a093f8303fb4485c9da4b7c4d9a64711'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:05.719963 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1209/2418] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:05 2022] DELETE /identity/v3/users/a093f8303fb4485c9da4b7c4d9a64711 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:05.724454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:05.724962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:05.725059 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:05.762402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:05.764660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:05.784989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:05.833419 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1210/2419] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:20:05.843178 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:05.844602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:05.906047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6a16c-ed19-438b-85fd-c6b6a96a5663 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:05.909771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:05.910384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:05.910669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:05.910948 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:05.921381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:05.922818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a77021-c888-4a10-94e2-ff349cae57fc service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:05.932485 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1210/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:06.112198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:06.113698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:06.128709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe0b2a-99e9-457e-8070-e540062bf7a2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:06.133783 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:06.135046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:06.135686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:06.135873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] PATH_INFO: `/v3/projects/e7453e77c873488bb24d66bdb9766282` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:06.137218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7453e77c873488bb24d66bdb9766282)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:06.139478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:06.196259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7453e77c873488bb24d66bdb9766282', 'request_id': 'req-020495ac-d46b-47b8-8ed7-2cdc5517dd49'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:06.202099 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7453e77c873488bb24d66bdb9766282', 'request_id': 'req-020495ac-d46b-47b8-8ed7-2cdc5517dd49'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:06.210022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7453e77c873488bb24d66bdb9766282', 'request_id': 'req-020495ac-d46b-47b8-8ed7-2cdc5517dd49'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:06.221153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] The token cache is being invalidate because project e7453e77c873488bb24d66bdb9766282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:06.221437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:06.222055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:06.223557 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1211/2421] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:06 2022] DELETE /identity/v3/projects/e7453e77c873488bb24d66bdb9766282 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:20:15.928145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:16.218369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:18.556117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:18.556566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:18.556848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:18.576687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:18.577907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:18.637984 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1211/2422] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:18.650769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:18.652251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:18.743737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020495ac-d46b-47b8-8ed7-2cdc5517dd49 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:18.748986 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:18.749603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:18.749919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:18.750232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:18.758835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:18.760509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c56e-99cd-446e-a200-53621cacf4e6 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:18.769195 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1212/2423] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:28.631120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=25 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:28.765580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=32 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:29.386115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:29.387799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:29.474575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426c1ab-8f05-4610-bebe-6800c3081295 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:29.479383 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:29.480168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:29.480548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:29.480925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] PATH_INFO: `/v3/users/fa8fa852a30441069ebebc6f2380caba` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:29.482214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8fa852a30441069ebebc6f2380caba)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:29.484624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:29.541435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8fa852a30441069ebebc6f2380caba'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:29.552028 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8fa852a30441069ebebc6f2380caba'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:29.553173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8fa852a30441069ebebc6f2380caba'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:29.554232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8fa852a30441069ebebc6f2380caba'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:29.572535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8fa852a30441069ebebc6f2380caba'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:29.591442 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1212/2424] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:29 2022] DELETE /identity/v3/users/fa8fa852a30441069ebebc6f2380caba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:29.597212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:29.597719 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:29.598107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:29.634423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:29.636624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:29.742359 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1213/2425] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:29.750625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:29.752342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:29.819916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316859f-71d4-4e35-b9de-cf8a1383646c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:29.824202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:29.824964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:29.825156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:29.825533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:29.836476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:29.837924 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3c919-d677-41c8-88ea-7672c00684b9 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:29.849455 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1213/2426] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:30.178154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.181297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:30.213077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e827df7-ed9c-4be8-ad58-ad8674ac0e7c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.219204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.220724 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.221143 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.221638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] PATH_INFO: `/v3/projects/6c69a07f0bef41879ab36a9408b648e9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.222998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c69a07f0bef41879ab36a9408b648e9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.225253 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.290331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c69a07f0bef41879ab36a9408b648e9', 'request_id': 'req-a3a44981-3979-4c46-a788-ad867f11e05c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:30.299090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c69a07f0bef41879ab36a9408b648e9', 'request_id': 'req-a3a44981-3979-4c46-a788-ad867f11e05c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:30.307410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c69a07f0bef41879ab36a9408b648e9', 'request_id': 'req-a3a44981-3979-4c46-a788-ad867f11e05c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:30.323091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] The token cache is being invalidate because project 6c69a07f0bef41879ab36a9408b648e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:30.323501 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:30.324447 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a3a44981-3979-4c46-a788-ad867f11e05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:30.326078 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1214/2427] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:30 2022] DELETE /identity/v3/projects/6c69a07f0bef41879ab36a9408b648e9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:30.332127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.332421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.332701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.354676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:30.355899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:30.381123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:30.435580 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1214/2428] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:20:30.443681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.444024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.444520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.467919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:30.469597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:30.478557 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1215/2429] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:30.484280 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.494957 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46840f-2288-41ab-a1f2-88aac1a75726 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.500441 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.501089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.501660 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.501953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.502656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:20:30.502973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.504631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.521053 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1215/2430] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:20:30.525671 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.539969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec90e-b051-4baf-b0fc-269467aeca75 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.545383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.546008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.546292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.546704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.547891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.551245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.590446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.590880 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1216/2431] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:20:30 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:30.602204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d544068-a08a-422f-b199-21bdc5f7cbd7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.701510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.702170 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.702716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.703746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.704554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.706945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.758587 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1216/2432] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:20:30 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:30.764511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.778430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9eaa-3b43-43c7-87f4-f388c108f038 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.785635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.786445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.786804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.787215 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.788061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.789807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.812642 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1217/2433] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:30.812877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.824118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5e41-f672-4444-bd36-f3878499404f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.830099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.840686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.840686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.840686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.840686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.840686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942751f-ac57-4a19-a51e-5b94948c5c04 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.858053 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1217/2434] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:30.864274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:30.880421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f719561-d9c9-4986-99ce-e6b7b7cb5b10 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:30.887025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:30.888730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.889108 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.889446 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] PATH_INFO: `/v3/projects/3ec342082183482abd2791ab4b6752bc/users/40b6fb28b8bd4c308b9bbef71bdfbc77/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.923402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec342082183482abd2791ab4b6752bc, user_id=40b6fb28b8bd4c308b9bbef71bdfbc77, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:30.923402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:30.935829 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1218/2435] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:20:30 2022] PUT /identity/v3/projects/3ec342082183482abd2791ab4b6752bc/users/40b6fb28b8bd4c308b9bbef71bdfbc77/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:20:30.946867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:30.947163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:30.948012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:30.981528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] MFA Rules not processed for user `40b6fb28b8bd4c308b9bbef71bdfbc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:30.982868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:31.071350 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1218/2436] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:31.086641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:31.088463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:31.113983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:31.163061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8f5d7-13b4-49eb-8e71-a342c6960e01 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:31.169707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:31.170534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:31.170877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:31.171262 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:31.184736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:31.186406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9124b9e-d465-4196-ad2b-2b1439f8713c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:31.204200 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1219/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:31.237274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:31.263638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:31.332798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ee7d-5433-45aa-a70b-5fcd77bff743 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:31.337749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:31.338732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:31.339254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:31.339790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] PATH_INFO: `/v3/users/40b6fb28b8bd4c308b9bbef71bdfbc77` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:31.341579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b6fb28b8bd4c308b9bbef71bdfbc77)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:31.344685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:31.416116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b6fb28b8bd4c308b9bbef71bdfbc77'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:31.424887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b6fb28b8bd4c308b9bbef71bdfbc77'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:31.431622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b6fb28b8bd4c308b9bbef71bdfbc77'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:31.432711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b6fb28b8bd4c308b9bbef71bdfbc77'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:31.463876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b6fb28b8bd4c308b9bbef71bdfbc77'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:31.479296 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1219/2438] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:31 2022] DELETE /identity/v3/users/40b6fb28b8bd4c308b9bbef71bdfbc77 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:31.484168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:31.484684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:31.485211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:31.507720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:31.510642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:31.596784 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1220/2439] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:31.602588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:31.604041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:31.681323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a222c2-61bf-4993-b43e-c9b346150e2d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:31.686938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:31.688480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:31.688844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:31.689220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:31.699836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:31.701373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aef520-84e3-40a1-9b86-44a60da5facc service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:31.720474 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1220/2440] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:32.092874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:32.094840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:32.115113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0e178-fd4a-4f16-bbb3-8fab31e3485d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:32.132427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:32.133404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:32.133826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:32.134646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] PATH_INFO: `/v3/projects/3ec342082183482abd2791ab4b6752bc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:32.135694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec342082183482abd2791ab4b6752bc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:32.137840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:32.220702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec342082183482abd2791ab4b6752bc', 'request_id': 'req-ba157d41-f0ba-41bc-9c49-38869a75d81a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:32.229706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec342082183482abd2791ab4b6752bc', 'request_id': 'req-ba157d41-f0ba-41bc-9c49-38869a75d81a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:32.238606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec342082183482abd2791ab4b6752bc', 'request_id': 'req-ba157d41-f0ba-41bc-9c49-38869a75d81a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:32.255863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] The token cache is being invalidate because project 3ec342082183482abd2791ab4b6752bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:32.256247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:32.256926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:32.267968 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1221/2441] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:32 2022] DELETE /identity/v3/projects/3ec342082183482abd2791ab4b6752bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:34.939866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:34.940398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:34.940496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:34.960480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:34.961605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:34.994227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:35.017413 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1221/2442] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:35.029502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:35.030987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:35.080026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:35.103476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba157d41-f0ba-41bc-9c49-38869a75d81a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:35.108425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:35.109178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:35.109457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:35.109728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:35.117649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:35.119213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:35.127827 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1222/2443] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:20:37.277350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:37.278939 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:37.349424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31803920-c230-47e8-8df8-9e3a4f0e8a29 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:37.353980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:37.354636 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.354930 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.355210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] PATH_INFO: `/v3/users/7c365049326e456a837eadc09c57a75e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.356425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c365049326e456a837eadc09c57a75e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:37.358421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:37.407669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c365049326e456a837eadc09c57a75e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.415006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c365049326e456a837eadc09c57a75e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.415695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c365049326e456a837eadc09c57a75e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.416355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c365049326e456a837eadc09c57a75e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.429046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1d9553cc-0529-4dd6-b7bd-7dd53e8bdad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c365049326e456a837eadc09c57a75e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.443990 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1222/2444] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:20:37 2022] DELETE /identity/v3/users/7c365049326e456a837eadc09c57a75e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:37.618479 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:37.632863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce35d3-8d6d-4030-bdee-443bde8129bd service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:37.692968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:37.693610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.693888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.694161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] PATH_INFO: `/v3/projects/0001dd85b7d8407798f76d0a66e88723` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.695310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0001dd85b7d8407798f76d0a66e88723)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:37.697242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:37.744036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0001dd85b7d8407798f76d0a66e88723', 'request_id': 'req-6856c7a8-20c8-48d3-b3c9-688c7b255b54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.749996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0001dd85b7d8407798f76d0a66e88723', 'request_id': 'req-6856c7a8-20c8-48d3-b3c9-688c7b255b54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.756776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0001dd85b7d8407798f76d0a66e88723', 'request_id': 'req-6856c7a8-20c8-48d3-b3c9-688c7b255b54'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.769244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] The token cache is being invalidate because project 0001dd85b7d8407798f76d0a66e88723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:20:37.769575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.770223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6856c7a8-20c8-48d3-b3c9-688c7b255b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:20:37.771713 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1223/2445] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:20:37 2022] DELETE /identity/v3/projects/0001dd85b7d8407798f76d0a66e88723 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:37.776670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.776964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.777244 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.799347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:37.801514 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:37.864759 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1223/2446] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:37.873096 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.873389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.873677 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.894225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:37.895440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:37.903525 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1224/2447] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:37.908628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:37.914736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:37.919886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bd2c6-3b8c-47ba-9326-9dca5b17b7ef None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:37.926563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:37.927385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.927892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.928268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.929207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:20:37.929519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:37.931269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:37.943042 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1224/2448] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:20:37.947337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:37.956942 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb360be-6c99-4866-9023-c4f637ab1dcd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:37.961619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:37.962226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:37.962510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:37.962786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:37.963448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:37.965372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:37.993061 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1225/2449] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:20:37 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:37.997251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.007912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9551fa-3201-4c70-a728-d8725d0ea774 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.065872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.066524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.066810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.067088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.067763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.069786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.091603 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1225/2450] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:20:37 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:20:38.096211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.106621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9497a-a0c3-445a-aa3b-f7ea5e746f2f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.112292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.112823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.113107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.113385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.114083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.115675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.125625 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1226/2451] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:38.129671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.139625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaea14-0d0d-4969-8e1e-646c2b1f0975 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.144491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.145101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.145385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.145663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.146347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.147959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c4709-18e5-4569-813f-4431705cca74 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.159443 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1226/2452] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:20:38.163849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.174821 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b2d15-dc41-4ad7-8812-2ab52af7a954 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.179540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.180240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.180557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.180838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] PATH_INFO: `/v3/projects/acac26b983c643a49d5c69bd3e16c8f9/users/ab34215f912240cab362d19f6e3b43f6/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.197760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acac26b983c643a49d5c69bd3e16c8f9, user_id=ab34215f912240cab362d19f6e3b43f6, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.200962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.214928 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1227/2453] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:20:38 2022] PUT /identity/v3/projects/acac26b983c643a49d5c69bd3e16c8f9/users/ab34215f912240cab362d19f6e3b43f6/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:20:38.220834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e138e55-6a87-4237-822c-a851dac777c0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.221217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e138e55-6a87-4237-822c-a851dac777c0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.221563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e138e55-6a87-4237-822c-a851dac777c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.242225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-8e138e55-6a87-4237-822c-a851dac777c0 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:38.243449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-8e138e55-6a87-4237-822c-a851dac777c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:38.306819 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1227/2454] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:20:38.316532 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:38.318348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:38.323668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:38.378181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9512-92fc-4cb0-9ff8-95970d9c0f50 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:38.381738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:38.382344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:38.382630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:38.382905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:38.392418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:38.393834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:38.403005 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1228/2455] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:20:39.021074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa04a-a704-4907-bf95-411975f416b9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.021362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa04a-a704-4907-bf95-411975f416b9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.021637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fa04a-a704-4907-bf95-411975f416b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.055478 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c06fa04a-a704-4907-bf95-411975f416b9 None None] MFA Rules not processed for user `ab34215f912240cab362d19f6e3b43f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:39.057034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c06fa04a-a704-4907-bf95-411975f416b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:39.132398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:39.137668 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1228/2456] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:39.148971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:20:39.150684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:39.229958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727b02e-31ff-4061-84ef-e7bb5e42cc97 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:20:39.234361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:20:39.235208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:39.235492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:39.235770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:39.247675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:20:39.249949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd3c5b-658e-4fbc-a580-a7a4bda88b46 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:20:39.259876 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1229/2457] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:20:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:20:40.684964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34113fdb-0c6e-4fd6-bad9-bae248f92653 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:20:40.685387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34113fdb-0c6e-4fd6-bad9-bae248f92653 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:20:40.685564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34113fdb-0c6e-4fd6-bad9-bae248f92653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:20:40.709633 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-34113fdb-0c6e-4fd6-bad9-bae248f92653 None None] MFA Rules not processed for user `ab34215f912240cab362d19f6e3b43f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:20:40.710856 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-34113fdb-0c6e-4fd6-bad9-bae248f92653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:20:40.718355 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1229/2458] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:20:49.255643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=51 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:20:50.701704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:08.042475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:08.043021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:08.043021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:08.062218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] MFA Rules not processed for user `f572af904d55419bb237899e3a3c8e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:08.063442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:08.119881 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1230/2459] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:09.128733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50345-afca-4503-9645-41c10766bdc0 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:09.129620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50345-afca-4503-9645-41c10766bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:09.130052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c50345-afca-4503-9645-41c10766bdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:09.149869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-84c50345-afca-4503-9645-41c10766bdc0 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:09.151309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-84c50345-afca-4503-9645-41c10766bdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:09.216742 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1230/2460] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:09.239563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:09.241510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:09.322387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcda07-b7bf-45fc-a139-484420fcf774 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:09.328771 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:09.329482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:09.336468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:09.337073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:09.348653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:09.350850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:09.364782 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1231/2461] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:21:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:21:19.209764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=25 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:19.360688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=57 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:19.538743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a781a9-7cc4-4940-8f5c-3d9dce21dd4e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:19.539035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a781a9-7cc4-4940-8f5c-3d9dce21dd4e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:19.539321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a781a9-7cc4-4940-8f5c-3d9dce21dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:19.566941 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e5a781a9-7cc4-4940-8f5c-3d9dce21dd4e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:19.568214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e5a781a9-7cc4-4940-8f5c-3d9dce21dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:19.577141 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1231/2462] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:19.608445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:19.611414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:19.725184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9648d3-a606-4fb3-94cd-458369ae6728 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:19.732043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:19.733109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:19.733544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:19.734496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:19.750212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:19.752070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:19.764496 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1232/2463] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:26.666199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:26.666733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:26.666733 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:26.689623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:26.691113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:26.708368 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1232/2464] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:26.731489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:26.746621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22687-5bad-486b-a727-3d390c692d4b service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:26.753629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:26.754258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:26.754545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:26.755483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:26.765256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:26.767481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd12d32-799b-48bf-b056-f57fc0bf7e7a service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:26.778441 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1233/2465] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:30.314387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:30.315852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:30.395332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf024-ae6f-4208-a52c-c29a1b6efa1c None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:30.400416 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:30.401036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:30.401321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:30.401601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:30.403350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:30.415555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:30.417195 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda16de-5b20-4b8c-9594-4b6eeb255b43 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:30.430278 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1233/2466] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:32.502816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.503349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.503445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.504805 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1234/2467] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:21:32.511217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fda4-32a7-4c86-a348-a44cf6ec16e1 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.511655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fda4-32a7-4c86-a348-a44cf6ec16e1 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.511749 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0fda4-32a7-4c86-a348-a44cf6ec16e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.534561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-46f0fda4-32a7-4c86-a348-a44cf6ec16e1 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:32.535791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-46f0fda4-32a7-4c86-a348-a44cf6ec16e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:32.545304 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1234/2468] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:32.556985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:32.558832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:32.641766 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd17b34-d49a-4cbe-beb1-6dbf758e1b2c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:32.645421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:32.646039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.646330 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.646605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.656999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:32.658434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37449-3b2a-42c8-9739-1f1000469b36 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:32.669102 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1235/2469] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:32.740038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c773aa-fcb1-4fa9-b951-14efc7aa8717 None None] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.740756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c773aa-fcb1-4fa9-b951-14efc7aa8717 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.741089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c773aa-fcb1-4fa9-b951-14efc7aa8717 None None] PATH_INFO: `/` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.742485 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1235/2470] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:21:32.747764 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219fcc-9bc6-4482-8a67-b0e833b190ce None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.748159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219fcc-9bc6-4482-8a67-b0e833b190ce None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.748575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219fcc-9bc6-4482-8a67-b0e833b190ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.768975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4e219fcc-9bc6-4482-8a67-b0e833b190ce None None] MFA Rules not processed for user `5ba914491e3643158d83fd51fbfc6263`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:32.770267 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e219fcc-9bc6-4482-8a67-b0e833b190ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:32.776894 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1236/2471] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:32.789099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c773aa-fcb1-4fa9-b951-14efc7aa8717 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:32.801914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c773aa-fcb1-4fa9-b951-14efc7aa8717 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:32.805949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:32.806587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.806984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.807261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.815452 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:32.816921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8a465-a0f5-4d1d-8b3f-8fe85a8cfcaf service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:32.824870 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1236/2472] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:32.922347 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.922669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.922980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.924431 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1237/2473] 10.222.0.47 () {54 vars in 921 bytes} [Sun Jul 31 01:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 31 01:21:32.929890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d3ea-5cc9-482d-8604-ed288d8c3257 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.930289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d3ea-5cc9-482d-8604-ed288d8c3257 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.930477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d3ea-5cc9-482d-8604-ed288d8c3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.950524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c012d3ea-5cc9-482d-8604-ed288d8c3257 None None] MFA Rules not processed for user `6f8bf5d3a0014e24af8195f4cdb1bf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:32.951714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c012d3ea-5cc9-482d-8604-ed288d8c3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:32.962032 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1237/2474] 10.222.0.47 () {58 vars in 1018 bytes} [Sun Jul 31 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:32.973461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:32.975264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:32.988684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276f181-df7d-4166-8527-c59aa1c5d4b6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:32.992572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3be69-c085-4768-a084-49dc0c0b7464 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.992717 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:32.992845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3be69-c085-4768-a084-49dc0c0b7464 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.993128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3be69-c085-4768-a084-49dc0c0b7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:32.993254 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:32.993473 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:32.993746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:33.004781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:33.006209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:33.013336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2ed3be69-c085-4768-a084-49dc0c0b7464 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:33.014665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2ed3be69-c085-4768-a084-49dc0c0b7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:33.017717 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1238/2475] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:33.024043 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1238/2476] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:21:33.045255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:33.057789 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48f7e5-11f6-4527-bfd1-8d7eabe65de8 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:33.064802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:33.065419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:33.065698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:33.065971 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:33.074716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:33.076329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:33.086533 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1239/2477] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:37.054905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d858bb-7ef4-4df0-b537-861321ed42c3 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:37.055375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d858bb-7ef4-4df0-b537-861321ed42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:37.055582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d858bb-7ef4-4df0-b537-861321ed42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:37.076282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-92d858bb-7ef4-4df0-b537-861321ed42c3 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:37.078109 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-92d858bb-7ef4-4df0-b537-861321ed42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:37.086133 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1239/2478] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:37.099156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:37.110776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298735d2-196c-45e5-b0b6-67f6b8a47131 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:37.116079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:37.116683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:37.116966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:37.117242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:37.125961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:37.127524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:37.135806 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1240/2479] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:21:37.142786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff569-7444-4e7b-bf8b-e29a3eb4286e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:37.143077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff569-7444-4e7b-bf8b-e29a3eb4286e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:37.143355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ff569-7444-4e7b-bf8b-e29a3eb4286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:37.164314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c85ff569-7444-4e7b-bf8b-e29a3eb4286e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:21:37.165695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c85ff569-7444-4e7b-bf8b-e29a3eb4286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:21:37.173741 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1240/2480] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:21:37.203816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:21:37.237319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21a8f6-dbc7-4dc4-a434-ba3ccf3a7548 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:21:37.252235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:21:37.253721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:21:37.254218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:21:37.256113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:21:37.274729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:37.279831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:21:37.284932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:21:37.310523 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1241/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:21:47.158311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=59 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:21:47.299209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:03.972727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e29b-d8da-4d67-9811-ab5ff8f10afe None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:03.973304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e29b-d8da-4d67-9811-ab5ff8f10afe None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:03.973304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e29b-d8da-4d67-9811-ab5ff8f10afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:03.993961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c524e29b-d8da-4d67-9811-ab5ff8f10afe None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:03.995163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c524e29b-d8da-4d67-9811-ab5ff8f10afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:04.004422 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1241/2482] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:04.026277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:04.028377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:04.043752 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd1d87-2d13-4e8b-9c0f-0af6f037bcdc service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:04.049938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:04.050559 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:04.050846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:04.051155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:04.059876 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:04.061493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:04.072133 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1242/2483] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:05.191821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c60c-8cd1-412e-9b7e-466bf547e6ae None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:05.192315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c60c-8cd1-412e-9b7e-466bf547e6ae None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:05.192579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c60c-8cd1-412e-9b7e-466bf547e6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:05.213438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-15e6c60c-8cd1-412e-9b7e-466bf547e6ae None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:05.214640 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-15e6c60c-8cd1-412e-9b7e-466bf547e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:05.222423 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1242/2484] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:05.235189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:05.246436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d58c4-9f6d-4cac-be85-794da2509f87 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:05.252138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:05.252745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:05.253028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:05.253302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:05.261284 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:05.262864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:05.271454 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1243/2485] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:22:09.200833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade279-5f4a-450c-b500-451f5ffdede9 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:09.201382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade279-5f4a-450c-b500-451f5ffdede9 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:09.201548 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ade279-5f4a-450c-b500-451f5ffdede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:09.221445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-83ade279-5f4a-450c-b500-451f5ffdede9 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:09.222655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-83ade279-5f4a-450c-b500-451f5ffdede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:09.231971 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1243/2486] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:09.256372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:09.268240 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65768674-9e14-4635-9a65-7b2adb3ea521 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:09.273817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:09.274422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:09.274708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:09.274987 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:09.283242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:09.284838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ce54f-a213-4894-8cad-c741bf067500 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:09.295242 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1244/2487] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:19.216243 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=9 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:19.290915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=18 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:26.611186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:26.611701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:26.611803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:26.630223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] MFA Rules not processed for user `ab34215f912240cab362d19f6e3b43f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:26.631953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:26.638757 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1244/2488] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:22:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:36.625166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:22:41.764265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2671-3930-4b75-a4a2-341c5567bdfa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:41.764782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2671-3930-4b75-a4a2-341c5567bdfa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:41.764877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2671-3930-4b75-a4a2-341c5567bdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:41.788658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-152b2671-3930-4b75-a4a2-341c5567bdfa None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:41.790833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-152b2671-3930-4b75-a4a2-341c5567bdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:41.798771 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1245/2489] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:41.819405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:41.832738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e096bb-a885-4c02-898b-6e3d5ef1afab None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:41.839030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:41.839646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:41.839945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:41.840236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:41.848576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:41.850274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:41.859868 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1245/2490] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:46.026907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b919-d3a3-45c2-b7af-7a22a671e129 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:46.027434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b919-d3a3-45c2-b7af-7a22a671e129 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:46.027434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b919-d3a3-45c2-b7af-7a22a671e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:46.046758 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5cf4b919-d3a3-45c2-b7af-7a22a671e129 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:46.047998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5cf4b919-d3a3-45c2-b7af-7a22a671e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:46.055852 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1246/2491] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:46.081630 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:46.094864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de597e34-24f3-40d4-80be-4d3179cd22b0 service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:46.100752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:46.101381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:46.101667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:46.101945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:46.110527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:46.112131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:46.121649 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1246/2492] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:22:50.170188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5594a1-2d75-4d86-aea1-1b9be1b20bcf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:50.170692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5594a1-2d75-4d86-aea1-1b9be1b20bcf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:50.170807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5594a1-2d75-4d86-aea1-1b9be1b20bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:50.190831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ee5594a1-2d75-4d86-aea1-1b9be1b20bcf None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:50.192076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee5594a1-2d75-4d86-aea1-1b9be1b20bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:50.201010 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1247/2493] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:50.221683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:50.233299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a46e2-6141-418d-9d53-9ef02928f03f service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:50.238970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:50.239587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:50.239872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:50.240203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:50.249302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:50.250877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:50.261215 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1247/2494] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:54.357651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b111be-780b-403b-b194-625ca919970a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:54.358173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b111be-780b-403b-b194-625ca919970a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:54.358276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b111be-780b-403b-b194-625ca919970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:54.379278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-28b111be-780b-403b-b194-625ca919970a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:54.380506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-28b111be-780b-403b-b194-625ca919970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:54.388324 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1248/2495] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:54.411133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:54.422780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee1692-ff68-41ad-8329-fe3faac7878c service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:54.428332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:54.428945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:54.429225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:54.429494 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:54.438549 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:54.440164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:54.450019 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1248/2496] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:22:58.553364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:58.553893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:58.554009 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:58.574504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:22:58.575715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:22:58.584490 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1249/2497] 10.222.0.58 () {58 vars in 1016 bytes} [Sun Jul 31 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:22:58.613831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:22:58.625843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d9445-07f7-4e0e-9526-913223823e8b service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:22:58.631365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:22:58.632005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:22:58.632294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:22:58.632567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:22:58.646305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:22:58.647982 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:22:58.660337 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1249/2498] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:08.568690 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=15 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:08.654444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=30 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:14.904791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:14.916255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840888a3-e925-4c49-b228-3f2e1921875a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:14.920461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:14.921133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:14.921420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:14.921699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:14.923827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:14.939704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:14.941246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121a7a2-b6b8-4575-9a9c-f3b188d73826 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:14.955327 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1250/2499] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:15.069010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:15.081242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b164c-74dd-47c4-8c78-d2c86802ef17 service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:15.084922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:15.085545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:15.086003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:15.086435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:15.089907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:15.105616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:15.107089 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834b3bd-a33a-4e6b-b766-eeed28ab9ae0 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:15.119923 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1250/2500] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:18.547871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:18.548397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:18.548509 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:18.570095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] MFA Rules not processed for user `9857d08d4d7a46e3a377e2d60673ab80`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:18.572581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:18.645293 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1251/2501] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:23:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:23.757786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:23.759049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:23.759049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:23.778288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] MFA Rules not processed for user `f572af904d55419bb237899e3a3c8e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:23.779531 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:23.786679 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1251/2502] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:23:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:23:24.984134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:24.997342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde74786-2f9a-420f-84cc-a01cdb866428 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:25.002889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:25.003510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:25.003794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:25.004105 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:25.005919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:25.025225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:25.028225 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:25.041277 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1252/2503] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:33.244091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:33.256112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e1788-4521-4658-b3fe-4b2757ac396e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:33.261907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:33.262526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:33.262808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:33.263088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:33.264905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:33.277407 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:33.279024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:33.290395 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1252/2504] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:33.305943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:33.318282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c21a88-98e6-4ce0-b63a-2cf15dccb183 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:33.326148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:33.326988 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:33.327272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:33.327782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] PATH_INFO: `/v3/users/ab34215f912240cab362d19f6e3b43f6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:33.329153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab34215f912240cab362d19f6e3b43f6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:33.331355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:33.380032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab34215f912240cab362d19f6e3b43f6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.387087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab34215f912240cab362d19f6e3b43f6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.387730 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab34215f912240cab362d19f6e3b43f6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.395065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab34215f912240cab362d19f6e3b43f6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.408054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab34215f912240cab362d19f6e3b43f6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.413935 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1253/2505] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:23:33 2022] DELETE /identity/v3/users/ab34215f912240cab362d19f6e3b43f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:33.597716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:33.609485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8210f-0486-4ecc-a781-96fd0fc637de service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:33.673616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:33.674271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:33.674556 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:33.674830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] PATH_INFO: `/v3/projects/acac26b983c643a49d5c69bd3e16c8f9` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:33.676043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=acac26b983c643a49d5c69bd3e16c8f9)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:33.679075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:33.730406 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acac26b983c643a49d5c69bd3e16c8f9', 'request_id': 'req-39113ea7-e79d-4b73-a500-573c0d07c2fc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.736929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acac26b983c643a49d5c69bd3e16c8f9', 'request_id': 'req-39113ea7-e79d-4b73-a500-573c0d07c2fc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.742932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acac26b983c643a49d5c69bd3e16c8f9', 'request_id': 'req-39113ea7-e79d-4b73-a500-573c0d07c2fc'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.758082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] The token cache is being invalidate because project acac26b983c643a49d5c69bd3e16c8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:23:33.758267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.759031 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:23:33.760744 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1253/2506] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:23:33 2022] DELETE /identity/v3/projects/acac26b983c643a49d5c69bd3e16c8f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:23:43.410211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:43.754533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:50.364990 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:50.366397 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:50.423151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933f751-bd77-4ecf-aef4-8c4244c53809 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:50.471835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:50.472478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:50.472759 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:50.473034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:50.474799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:50.531216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:50.532667 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda43b20-1901-40ec-9336-7c76cbe1aba9 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:50.541842 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1254/2507] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:54.736388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:54.738045 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:54.825929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39113ea7-e79d-4b73-a500-573c0d07c2fc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:54.833347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:54.834083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:54.834483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:54.834863 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:54.836829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:54.849554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:54.851176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:54.865088 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1254/2508] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:57.344287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:57.344804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:57.344903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:57.364188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] MFA Rules not processed for user `e117c5cc43a34179b69ac8ba1529b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:23:57.365331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:57.372381 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1255/2509] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:23:57.675464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:57.676944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:57.732350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33582c23-922f-4091-9068-dfa9a64bcc9b service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:57.735866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:57.736501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:57.736783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:57.737060 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:57.738763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:57.748753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:57.750163 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:57.758123 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1255/2510] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:23:58.069257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:23:58.070753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:58.142031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27032a-0937-4852-b7c8-f5fbc451ad1b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:23:58.147037 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:23:58.147651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:23:58.147943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:23:58.148258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:23:58.150190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:23:58.158602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:23:58.162957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:23:58.165177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:23:58.175647 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1256/2511] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:00.041955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:00.050857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465257bc-7336-4ae6-b5a0-675929320c1d service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:00.056530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:00.057172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:00.057454 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:00.057728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:00.059496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:00.069906 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:00.072059 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:00.082003 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1256/2512] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:06.584541 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:06.598207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276466f-f34f-4c24-8c00-5a1abe091f0e service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:06.604720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:06.605341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:06.605619 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:06.605890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:06.607669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:06.620312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:06.621887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:06.632601 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1257/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:10.077137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:16.628103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=9 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:41.722975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:41.724348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:41.741597 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26244450-be4d-4ced-8b6c-bd5f0c69f7e6 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:41.747159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:41.747766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:41.748093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:41.748375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:41.750084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:41.800308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:41.808929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:41.810286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450acca5-c33b-48de-a588-fc4cdccb1b85 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:41.810528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:41.813914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:41.814520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:41.814807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:41.815087 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:41.820454 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1257/2514] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:24:41.824244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:41.825666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:41.835913 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1258/2515] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:24:51.816852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=28 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:51.830943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:24:56.690519 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:24:56.700041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f6e81-7952-4d41-80ab-ee34023711da service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:24:56.703661 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:24:56.704301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:24:56.704583 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:24:56.705120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:24:56.706877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:24:56.769651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:24:56.771067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:24:56.781869 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1258/2516] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:00.298179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:00.311795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4c209-0a2c-4462-9c8b-1ff845334df4 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:00.320556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:00.321315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:00.321665 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:00.322011 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:00.323856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:00.338188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:00.339948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:00.351704 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1259/2517] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:00.378977 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:00.380631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:00.394184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da75ea-d7fa-4389-b791-d7d9329c608d service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:00.400369 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:00.401014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:00.401296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:00.401570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] PATH_INFO: `/v3/users/f572af904d55419bb237899e3a3c8e8d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:00.402753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f572af904d55419bb237899e3a3c8e8d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:00.404748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:00.456122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f572af904d55419bb237899e3a3c8e8d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.463670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f572af904d55419bb237899e3a3c8e8d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.464511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f572af904d55419bb237899e3a3c8e8d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.465238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f572af904d55419bb237899e3a3c8e8d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.478629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c973be9-5233-4dca-ad05-786fb5ecea12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f572af904d55419bb237899e3a3c8e8d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.491903 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1259/2518] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:00 2022] DELETE /identity/v3/users/f572af904d55419bb237899e3a3c8e8d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:00.673930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:00.697574 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92682f82-9681-4c1a-921c-db0719f988dd service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:00.762800 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:00.763443 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:00.763722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:00.764036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] PATH_INFO: `/v3/projects/e167fa3c551f447fb495f25d1aed741d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:00.765186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e167fa3c551f447fb495f25d1aed741d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:00.767102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:00.812640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e167fa3c551f447fb495f25d1aed741d', 'request_id': 'req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.818025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e167fa3c551f447fb495f25d1aed741d', 'request_id': 'req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.825227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e167fa3c551f447fb495f25d1aed741d', 'request_id': 'req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.836946 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] The token cache is being invalidate because project e167fa3c551f447fb495f25d1aed741d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:00.837236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.837867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a0c69a0b-97c8-4fd7-9d10-5f0a6f12486c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:00.839614 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1260/2519] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:00 2022] DELETE /identity/v3/projects/e167fa3c551f447fb495f25d1aed741d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:00.844375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:00.844577 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:00.845044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:00.867959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:00.869225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:00.938453 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1260/2520] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:00.946499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:00.946798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:00.947081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:00.971278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:00.972716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:00.983374 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1261/2521] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:00.987457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:00.998374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ca3b-eb68-4a48-a6bb-10b9ebbbf516 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.003316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.004100 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.004481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.004865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.005670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:25:01.006078 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.008445 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.010992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:01.027885 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1261/2522] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:25:01.029174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.038905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508c6f8-3de2-492b-b045-a453ea12b2ae None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.043808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.044453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.044735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.045008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.045684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.047573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.074767 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1262/2523] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:01 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:01.078884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.089789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008edf2-48ab-47be-b8bc-be690f5964e2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.144330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.145003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.145291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.145564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.146213 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.148734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.169660 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1262/2524] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:01 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:01.173776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.184737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eec748-9c47-4cbc-8f1b-6afc331995d0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.189384 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.189992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.190278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.190561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.191246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.192862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.205233 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1263/2525] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:01.209126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.219129 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813916-c9ea-4c67-bd49-4316e1cb48ad admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.223921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.224612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.224914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.225196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.225888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.227566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffe33c-bd2b-432c-9280-f5b54112b36c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.238145 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1263/2526] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:01.242830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.252710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059b1c6-df1f-4510-a39a-1aecc30c3fb8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.257976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.258636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.258928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.259192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] PATH_INFO: `/v3/projects/a6429f855e92487e8ae8dc7462ce31af/users/89ba6b2f9636494f8c6022056961b3ed/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.273623 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6429f855e92487e8ae8dc7462ce31af, user_id=89ba6b2f9636494f8c6022056961b3ed, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.276298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.289074 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1264/2527] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:01 2022] PUT /identity/v3/projects/a6429f855e92487e8ae8dc7462ce31af/users/89ba6b2f9636494f8c6022056961b3ed/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:25:01.300120 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.300410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.300683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.329010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] MFA Rules not processed for user `89ba6b2f9636494f8c6022056961b3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:01.330489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:01.395280 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1264/2528] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:01.407302 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:01.409014 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:01.423565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:01.486700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fabc80-8184-4743-b3e1-05543f0d4dca admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:01.492974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:01.493593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:01.493882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:01.494163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:01.501979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:01.503570 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7706d8-b918-44d5-b158-a9f29b0beb70 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:01.513313 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1265/2529] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:04.173554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:04.236712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e15e5-b77f-4194-ae9b-28b54ca9b5ab None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:04.242012 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:04.242656 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.242940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.243217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] PATH_INFO: `/v3/users/89ba6b2f9636494f8c6022056961b3ed` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:04.244425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ba6b2f9636494f8c6022056961b3ed)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:04.246396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:04.248712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:04.293409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ba6b2f9636494f8c6022056961b3ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.300279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ba6b2f9636494f8c6022056961b3ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.300970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ba6b2f9636494f8c6022056961b3ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.301613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ba6b2f9636494f8c6022056961b3ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.313888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ba6b2f9636494f8c6022056961b3ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.326790 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1265/2530] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:04 2022] DELETE /identity/v3/users/89ba6b2f9636494f8c6022056961b3ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:04.331721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.332246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.332341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:04.351124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:04.352352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:04.411697 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1266/2531] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:04.421850 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:04.423352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:04.485326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105e677-545f-40a3-a629-8240a7cd78f7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:04.489205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:04.489759 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.490039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.490312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:04.499627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:04.501093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1b38a-36ce-41bf-ba84-45cfc2f94d33 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:04.511026 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1266/2532] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:04.797124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:04.798692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:04.811685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ddbcd-3047-4ae5-a7aa-0b2eaf0d68a4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:04.816540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:04.817187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.817598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.817882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] PATH_INFO: `/v3/projects/a6429f855e92487e8ae8dc7462ce31af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:04.819614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6429f855e92487e8ae8dc7462ce31af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:04.821569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:04.870126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6429f855e92487e8ae8dc7462ce31af', 'request_id': 'req-675db416-0d1c-409b-96d7-3d8b8901a5d1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.875508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6429f855e92487e8ae8dc7462ce31af', 'request_id': 'req-675db416-0d1c-409b-96d7-3d8b8901a5d1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.883896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6429f855e92487e8ae8dc7462ce31af', 'request_id': 'req-675db416-0d1c-409b-96d7-3d8b8901a5d1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.895198 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] The token cache is being invalidate because project a6429f855e92487e8ae8dc7462ce31af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:04.895486 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.896128 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-675db416-0d1c-409b-96d7-3d8b8901a5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:04.898176 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1267/2533] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:04 2022] DELETE /identity/v3/projects/a6429f855e92487e8ae8dc7462ce31af => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:04.902995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.903299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.903557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:04.922657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:04.923852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:04.982808 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1267/2534] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:04.991305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:04.991651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:04.991957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.012718 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:05.013948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:05.021838 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1268/2535] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:05.026081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.035606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2c246-4df8-4337-9498-ce95d03b4975 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.040290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.040893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.041175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.041447 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.042132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:25:05.042431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.044032 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.055971 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1268/2536] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:25:05.060118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.070131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1beece6-47da-415d-a174-72b27fc1e1d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.074816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.075419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.075699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.076007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.076673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.078557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.093605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:05.106168 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1269/2537] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:05.110277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.120868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff4e3c-d1f6-42ed-98e3-d63485ec787c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.128517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:05.179574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.180242 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.180475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.180747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.181395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.183368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.204564 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1269/2538] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:05.209206 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.219500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0f65-b37e-4ebd-abc4-002ee96379ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.224129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.224763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.225139 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.225419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.226098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.227689 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.237463 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1270/2539] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:25:05.242281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.252225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5cd19-7982-44de-a9fb-15a990e53687 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.257876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.258480 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.258766 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.259044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.259736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.261363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734ac4b-2caa-4e57-a013-ade2a12dcfc3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.271788 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1270/2540] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:25:05.275921 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.286062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89f2a-5140-4ac1-9d98-74921fb557a0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.291238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.291884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.292194 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.292472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] PATH_INFO: `/v3/projects/cd81a61580ce4ea4b8f2dc8d03f278b1/users/ec5c2064eb3e45ae9c00af3ea712c118/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.307552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd81a61580ce4ea4b8f2dc8d03f278b1, user_id=ec5c2064eb3e45ae9c00af3ea712c118, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.310216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.322859 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1271/2541] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:05 2022] PUT /identity/v3/projects/cd81a61580ce4ea4b8f2dc8d03f278b1/users/ec5c2064eb3e45ae9c00af3ea712c118/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:05.333902 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.334258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.334710 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.364544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] MFA Rules not processed for user `ec5c2064eb3e45ae9c00af3ea712c118`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:05.366913 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:05.431691 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1271/2542] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:05.435852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.501782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a1c77-5e7f-4af6-8073-0d5eb0ee719d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.507004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.507617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.507904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.508223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.508896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.510805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.537459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1272/2543] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:25:05.541538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.552711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab400837-c5fa-4a05-9d7b-b29e8346b1e8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.611821 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.612477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.612770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.613049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.613727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.616466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.641083 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1272/2544] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:05.642305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.653899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9456f5-1d3a-485a-9d71-fad8383c245a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.659654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.660581 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.661036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.661398 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.662090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.664576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.681733 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1273/2545] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:05.682938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.693426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49b272-a9eb-4aff-b09e-105e916c539c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.698293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.698964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.699253 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.699538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] PATH_INFO: `/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8/users/fa835a2b822c4ce7be283b4a6694eb46/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.702783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:05.716653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f3d73ceb8f4ed293d8e0bcb60d4ab8, user_id=fa835a2b822c4ce7be283b4a6694eb46, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.719405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.733486 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1273/2546] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:05 2022] PUT /identity/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8/users/fa835a2b822c4ce7be283b4a6694eb46/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:05.737489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.748158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f604591-e048-436c-80ed-633c7ab177b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.805325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.805863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.806151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.806431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.807121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.808750 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586d3ae-de45-435b-ba25-90c86c1ebd28 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.818357 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1274/2547] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:05.822595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.833363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0536d5-85ce-4236-a9d5-676fa908a3aa admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:05.838652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:05.839367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.839667 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.839958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] PATH_INFO: `/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8/users/fa835a2b822c4ce7be283b4a6694eb46/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.841919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f3d73ceb8f4ed293d8e0bcb60d4ab8, user_id=fa835a2b822c4ce7be283b4a6694eb46, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:05.844619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:05.855741 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1274/2548] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:05 2022] PUT /identity/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8/users/fa835a2b822c4ce7be283b4a6694eb46/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:05.867371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:05.867661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:05.867951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:05.898171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] MFA Rules not processed for user `fa835a2b822c4ce7be283b4a6694eb46`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:05.899389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:05.916603 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:05.971959 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1275/2549] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:25:05.983631 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:05.985350 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:06.052319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf898-583f-4685-bb24-1ae171677b8e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:06.057603 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:06.058227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:06.058628 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:06.058907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:06.068632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:06.070278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430984da-5942-4197-be2c-54add1ba6bcd service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:06.080082 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1275/2550] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:06.153917 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:06.164437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e522c-8ef3-452c-b5e0-1b3e72c6c453 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:06.168113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:06.168722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:06.169003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:06.169298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:06.228378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:06.229803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:06.238710 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1276/2551] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:11.842496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e31c-09da-4dd3-b567-345b2d17640d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:11.843021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e31c-09da-4dd3-b567-345b2d17640d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:11.843115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e31c-09da-4dd3-b567-345b2d17640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:11.862988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5dc0e31c-09da-4dd3-b567-345b2d17640d None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:11.864240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5dc0e31c-09da-4dd3-b567-345b2d17640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:11.919806 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1276/2552] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:11.966062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:11.967500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:12.035910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7c88c-72e3-454f-b24a-a8c736d4591f service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:12.041666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:12.042281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:12.042563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:12.042838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:12.052121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:12.053791 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:12.062302 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1277/2553] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:25:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:21.912671 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:22.058996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:27.699272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:27.699794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:27.700137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:27.720557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:27.721868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:27.731619 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1277/2554] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:27.745171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:27.757220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb1bb-f488-4e60-8103-b510202c727c service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:27.762735 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:27.763522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:27.764072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:27.764592 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:27.774282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:27.776025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe5e83-0770-412e-bc9f-1f05e6746de2 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:27.785402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1278/2555] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:37.715184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:37.781841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:39.766476 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:39.828911 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c69e2-3fa6-43d8-85b8-cdf5ab9b189a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:39.834374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:39.835002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:39.835287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:39.835565 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] PATH_INFO: `/v3/users/ec5c2064eb3e45ae9c00af3ea712c118` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:39.836774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5c2064eb3e45ae9c00af3ea712c118)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:39.838690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:39.883674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5c2064eb3e45ae9c00af3ea712c118'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:39.890471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5c2064eb3e45ae9c00af3ea712c118'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:39.891139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5c2064eb3e45ae9c00af3ea712c118'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:39.891755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5c2064eb3e45ae9c00af3ea712c118'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:39.904172 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5c2064eb3e45ae9c00af3ea712c118'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:39.916394 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1278/2556] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:39 2022] DELETE /identity/v3/users/ec5c2064eb3e45ae9c00af3ea712c118 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:25:39.920948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:39.921454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:39.921582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:39.940243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:39.941467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:40.000005 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1279/2557] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:40.010451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:40.011867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:40.070202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ad23b-85ea-411c-a9de-04cd121d6009 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:40.073933 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:40.074547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:40.074834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:40.075112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:40.084458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:40.085888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:40.095285 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1279/2558] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:40.386675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:40.388586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:40.404110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c09151-ef65-4021-9230-fc0a66a40d84 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:40.409452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:40.410153 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:40.410362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:40.410636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] PATH_INFO: `/v3/projects/cd81a61580ce4ea4b8f2dc8d03f278b1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:40.412784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd81a61580ce4ea4b8f2dc8d03f278b1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:40.415227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:40.464678 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd81a61580ce4ea4b8f2dc8d03f278b1', 'request_id': 'req-14ca00ef-6f19-4fad-b023-197f8491c487'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.470582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd81a61580ce4ea4b8f2dc8d03f278b1', 'request_id': 'req-14ca00ef-6f19-4fad-b023-197f8491c487'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.478612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd81a61580ce4ea4b8f2dc8d03f278b1', 'request_id': 'req-14ca00ef-6f19-4fad-b023-197f8491c487'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.490817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] The token cache is being invalidate because project cd81a61580ce4ea4b8f2dc8d03f278b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:40.491106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.491851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.493811 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1280/2559] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:40 2022] DELETE /identity/v3/projects/cd81a61580ce4ea4b8f2dc8d03f278b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:40.497934 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:40.508098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61082-1e1d-4815-8f84-958cc50b9f53 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:40.526947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:40.570751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:40.571388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:40.571666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:40.571954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] PATH_INFO: `/v3/users/fa835a2b822c4ce7be283b4a6694eb46` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:40.573240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa835a2b822c4ce7be283b4a6694eb46)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:40.575205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:40.620978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa835a2b822c4ce7be283b4a6694eb46'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.627888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa835a2b822c4ce7be283b4a6694eb46'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.628601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa835a2b822c4ce7be283b4a6694eb46'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.629218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa835a2b822c4ce7be283b4a6694eb46'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.641801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-9c45c5b9-c1a9-44c1-92af-8298cc711552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa835a2b822c4ce7be283b4a6694eb46'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:40.656587 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1280/2560] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:40 2022] DELETE /identity/v3/users/fa835a2b822c4ce7be283b4a6694eb46 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:40.928381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:40.930388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:40.948134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca00ef-6f19-4fad-b023-197f8491c487 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.009938 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.010587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.010871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.011151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] PATH_INFO: `/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.012345 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f3d73ceb8f4ed293d8e0bcb60d4ab8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.014247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.045144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:41.063271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f3d73ceb8f4ed293d8e0bcb60d4ab8', 'request_id': 'req-facbbb94-60ad-4d8e-9371-503c2d53a0d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:41.068889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f3d73ceb8f4ed293d8e0bcb60d4ab8', 'request_id': 'req-facbbb94-60ad-4d8e-9371-503c2d53a0d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:41.076283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f3d73ceb8f4ed293d8e0bcb60d4ab8', 'request_id': 'req-facbbb94-60ad-4d8e-9371-503c2d53a0d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:41.088034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] The token cache is being invalidate because project 17f3d73ceb8f4ed293d8e0bcb60d4ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:41.088323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:41.088975 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-facbbb94-60ad-4d8e-9371-503c2d53a0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:41.090482 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1281/2561] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:40 2022] DELETE /identity/v3/projects/17f3d73ceb8f4ed293d8e0bcb60d4ab8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:41.095385 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.095979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.096095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.115832 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:41.117074 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:41.175064 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1281/2562] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:41.182911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.183200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.183481 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.202969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:41.204213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:41.215459 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1282/2563] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:41.219472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.230097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa70659-e059-481f-b3ba-aae3f68e9164 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.234658 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.235269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.235559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.235839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.236580 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:25:41.236888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.238495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.249945 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1282/2564] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:25:41.254212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.264104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb527f-13dc-4563-951f-f49dfdf9f875 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.268840 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.269448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.269736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.270012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.271308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.273244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.301087 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1283/2565] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:41.306429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.316523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defe92-043a-4674-b07e-3e6bab771cd2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.343523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:41.375037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.375645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.375955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.376234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.376878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.378790 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.401417 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1283/2566] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:41.405609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.416327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce91393-b690-4a93-8fa5-8825761ff85a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.421271 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.421882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.422161 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.422434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.423152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.424770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.440440 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1284/2567] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:41.444955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.455654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35aa6-f7a0-4624-a1a1-2cdbe3ee83ce admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.462606 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.463232 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.463646 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.463946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.464650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.466320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a74f15-0820-4c66-844f-4491126d7cfd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.478346 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1284/2568] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:41.482498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.492652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5d1c-779c-4d12-b8fe-ec662b16b200 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.497675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.498354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.498639 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.498919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] PATH_INFO: `/v3/projects/5112fcfa56d2469da084d93108183000/users/19e8d6fe3ca94071a9b08e28c16209c3/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.515915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5112fcfa56d2469da084d93108183000, user_id=19e8d6fe3ca94071a9b08e28c16209c3, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.518572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.540988 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1285/2569] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:41 2022] PUT /identity/v3/projects/5112fcfa56d2469da084d93108183000/users/19e8d6fe3ca94071a9b08e28c16209c3/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:41.551374 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.552334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.552756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.581054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] MFA Rules not processed for user `19e8d6fe3ca94071a9b08e28c16209c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:41.582261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:41.646387 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1285/2570] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:41.651051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.712597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61b340-8ca2-4ea1-9ff5-fab4fa5271b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.717392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.717965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.718242 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.718517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.719191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.721483 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.748910 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1286/2571] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:25:41.752918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.764903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e72e1-97f5-4fb2-83a4-f717de64fa5a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.822290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.822912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.823202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.823482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.824190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.826096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.846514 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1286/2572] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:25:41.850904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.861278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f180-52e0-42f9-afff-00d9f1f28133 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.866461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.867070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.867353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.867630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.868374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.869992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.881029 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1287/2573] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:41.885104 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.895186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80af179-c1d2-4992-a1d5-b63081ba8a1f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.900023 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:41.900728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:41.901046 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:41.901404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] PATH_INFO: `/v3/projects/448e27077d6640e6a86b1ea63f38f17f/users/683196983f7441b59092201332538225/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:41.916534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e27077d6640e6a86b1ea63f38f17f, user_id=683196983f7441b59092201332538225, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:41.919173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:41.932479 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1287/2574] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:41 2022] PUT /identity/v3/projects/448e27077d6640e6a86b1ea63f38f17f/users/683196983f7441b59092201332538225/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:41.936315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:41.947342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529f3ad-b95a-441b-b040-9964da394c45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:41.967032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:42.004550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:42.005737 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.006034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.006304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.006981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:42.008641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957c030-b83b-4438-a6d6-c1fcd7a11001 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:42.018267 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1288/2575] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:42.022437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:42.028049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:42.034511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4be04-743a-48ef-a713-d9d4c6bcc5b9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:42.040168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:42.040874 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.041156 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.041432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] PATH_INFO: `/v3/projects/448e27077d6640e6a86b1ea63f38f17f/users/683196983f7441b59092201332538225/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.043381 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e27077d6640e6a86b1ea63f38f17f, user_id=683196983f7441b59092201332538225, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:42.046039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:42.056743 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1288/2576] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:42 2022] PUT /identity/v3/projects/448e27077d6640e6a86b1ea63f38f17f/users/683196983f7441b59092201332538225/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:42.066848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.067140 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.067510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.095274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] MFA Rules not processed for user `683196983f7441b59092201332538225`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:42.096519 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:42.167241 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1289/2577] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:42.179356 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:42.181117 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:42.239690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdd0ca-5a76-42cc-93b9-1cd10d8debd1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:42.243437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:42.244086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.244378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.244655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.253711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:42.255469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b36e9e-32a5-40b6-bb96-4c6e1cb9f465 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:42.264911 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1289/2578] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:42.649963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:42.714751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba8b20-1637-4f31-af0b-0240c09d97f0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:42.719682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:42.720442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.720732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.721016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] PATH_INFO: `/v3/users/19e8d6fe3ca94071a9b08e28c16209c3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.722252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e8d6fe3ca94071a9b08e28c16209c3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:42.725333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:42.780553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e8d6fe3ca94071a9b08e28c16209c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:42.782213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:42.789882 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e8d6fe3ca94071a9b08e28c16209c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:42.791068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e8d6fe3ca94071a9b08e28c16209c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:42.798973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e8d6fe3ca94071a9b08e28c16209c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:42.811171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e8d6fe3ca94071a9b08e28c16209c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:42.817138 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1290/2579] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:42 2022] DELETE /identity/v3/users/19e8d6fe3ca94071a9b08e28c16209c3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:42.822429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.822722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.823002 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.842533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:42.843744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:42.901935 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1290/2580] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:42.912039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:42.913465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:42.980816 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff1ffb-3624-41b5-b469-fb57ca75ad54 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:42.984753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:42.985370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:42.985651 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:42.985926 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:42.995563 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:42.997003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:43.007401 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1291/2581] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:43.284332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:43.285844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:43.307807 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110b076-a331-4444-b894-fc9e510ef3b7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:43.313327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:43.314806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:43.315418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:43.315848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] PATH_INFO: `/v3/projects/5112fcfa56d2469da084d93108183000` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:43.318287 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5112fcfa56d2469da084d93108183000)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:43.320801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:43.377383 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5112fcfa56d2469da084d93108183000', 'request_id': 'req-3394df44-2423-4b0c-9887-a796f67a32bd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.386176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5112fcfa56d2469da084d93108183000', 'request_id': 'req-3394df44-2423-4b0c-9887-a796f67a32bd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.392687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5112fcfa56d2469da084d93108183000', 'request_id': 'req-3394df44-2423-4b0c-9887-a796f67a32bd'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.408302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] The token cache is being invalidate because project 5112fcfa56d2469da084d93108183000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:43.408600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.409808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.412762 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1291/2582] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:43 2022] DELETE /identity/v3/projects/5112fcfa56d2469da084d93108183000 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:43.416827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:43.428459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f5b5c-d28d-405f-847f-bb3529b5b44d service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:43.507796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:43.509121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:43.509399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:43.509675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] PATH_INFO: `/v3/users/683196983f7441b59092201332538225` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:43.510929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=683196983f7441b59092201332538225)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:43.512909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:43.565436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683196983f7441b59092201332538225'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.573617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683196983f7441b59092201332538225'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.574313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683196983f7441b59092201332538225'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.581564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683196983f7441b59092201332538225'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.587991 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:43.596023 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1d97ac93-350f-4d0e-8235-55b770ee7c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683196983f7441b59092201332538225'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:43.603644 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1292/2583] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:43 2022] DELETE /identity/v3/users/683196983f7441b59092201332538225 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:25:43.888719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:43.890854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:43.919972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394df44-2423-4b0c-9887-a796f67a32bd admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:43.931589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:43.986401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:43.987088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:43.987379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:43.987663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] PATH_INFO: `/v3/projects/448e27077d6640e6a86b1ea63f38f17f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:43.988884 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] RBAC: Authorizing `identity:delete_project(project_id=448e27077d6640e6a86b1ea63f38f17f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:43.990916 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.051133 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448e27077d6640e6a86b1ea63f38f17f', 'request_id': 'req-af590e6f-3093-4631-b106-da5d255f668d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:44.060302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448e27077d6640e6a86b1ea63f38f17f', 'request_id': 'req-af590e6f-3093-4631-b106-da5d255f668d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:44.069371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448e27077d6640e6a86b1ea63f38f17f', 'request_id': 'req-af590e6f-3093-4631-b106-da5d255f668d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:44.083471 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] The token cache is being invalidate because project 448e27077d6640e6a86b1ea63f38f17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:44.083857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:44.084553 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-af590e6f-3093-4631-b106-da5d255f668d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:44.086121 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1292/2584] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:43 2022] DELETE /identity/v3/projects/448e27077d6640e6a86b1ea63f38f17f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:44.090911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.091348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.091503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.111358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:44.113086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:44.179229 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1293/2585] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:25:44.247329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.247624 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.247912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.270991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:44.272592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:44.281493 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1293/2586] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:44.285999 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.296729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bba7fe-ffa3-40f4-bad5-e979558b147e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.301993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.302770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.303123 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.303497 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.304334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:25:44.304709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.306775 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.321359 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1294/2587] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:25:44.325990 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.337923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced98ca-6bce-4946-a87f-5dee9c40429b None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.348789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.349604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.349998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.350278 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.351199 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.353171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.383436 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1294/2588] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:25:44 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:25:44.387448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.405399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234dd8a-92c5-400e-a347-a2e0d2b1c6a3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.468319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.468940 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.469222 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.469502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.470159 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.472117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.492016 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1295/2589] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:25:44 2022] POST /identity/v3/users => generated 281 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:25:44.496348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.507718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac371ae-752f-4453-a062-41c08058e01b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.512672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.513288 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.513574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.513854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.514551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.516175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.652113 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1295/2590] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:44.656183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.667162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268eff6-13b7-42e7-b960-c76583c62499 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.671738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.672372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.672654 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.672927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.673606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.675189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db39fa-d193-4e62-ba10-17bbf742e8e1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.686003 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1296/2591] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:25:44.689986 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.699904 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4754b1a-65a8-4e1f-a9cd-748eb31a935c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.704546 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.705463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.705744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.706020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] PATH_INFO: `/v3/projects/31419abef5074839b9bc6149b3c80932/users/582dc56ea9b6462d866fcf42b16d1f60/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.720617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=31419abef5074839b9bc6149b3c80932, user_id=582dc56ea9b6462d866fcf42b16d1f60, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.723224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.736453 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1296/2592] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:25:44 2022] PUT /identity/v3/projects/31419abef5074839b9bc6149b3c80932/users/582dc56ea9b6462d866fcf42b16d1f60/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:44.746489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.746781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.747066 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.774818 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] MFA Rules not processed for user `582dc56ea9b6462d866fcf42b16d1f60`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:44.776113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:44.818605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:44.843874 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1297/2593] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:44.877984 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:44.879694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:44.927601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:44.941340 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8fbe4-eba3-4cd1-b34c-7c2699d7c3fc admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:44.945183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:44.945825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:44.946111 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:44.946414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:44.955084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:44.956623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288d0b5-e335-4c66-99e0-4b95be2db163 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:44.966446 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1297/2594] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:44.982281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:45.049698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809977a2-04ef-4588-8ded-0fe2e8d6be1e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:45.054763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:45.055405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:45.055693 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:45.056004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] PATH_INFO: `/v3/users/582dc56ea9b6462d866fcf42b16d1f60` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:45.057263 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=582dc56ea9b6462d866fcf42b16d1f60)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:45.059192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:45.107218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582dc56ea9b6462d866fcf42b16d1f60'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.115589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582dc56ea9b6462d866fcf42b16d1f60'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.116374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582dc56ea9b6462d866fcf42b16d1f60'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.123547 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582dc56ea9b6462d866fcf42b16d1f60'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.136888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582dc56ea9b6462d866fcf42b16d1f60'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.143047 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1298/2595] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:25:44 2022] DELETE /identity/v3/users/582dc56ea9b6462d866fcf42b16d1f60 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:45.148190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:45.148485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:45.148765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:45.167699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:45.168952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:45.228372 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1298/2596] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:25:45.237972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:45.239530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:45.298635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d599df9-93c5-47fa-adce-6bfe87234d1f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:45.302471 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:45.303095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:45.303380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:45.303659 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:45.312890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:45.314324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b378808-ae09-4084-b0f6-f7f0e6b5ae00 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:45.325149 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1299/2597] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:25:45.640518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:45.642840 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:45.656791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87edb4-9358-4f31-b2d4-6c2ab7ab72b4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:45.665511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:45.666483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:45.666838 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:45.667194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] PATH_INFO: `/v3/projects/31419abef5074839b9bc6149b3c80932` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:45.668481 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31419abef5074839b9bc6149b3c80932)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:45.670560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:45.740595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31419abef5074839b9bc6149b3c80932', 'request_id': 'req-5feb122c-afd1-483f-83ca-afaf4868e2f2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.747058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31419abef5074839b9bc6149b3c80932', 'request_id': 'req-5feb122c-afd1-483f-83ca-afaf4868e2f2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.754022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31419abef5074839b9bc6149b3c80932', 'request_id': 'req-5feb122c-afd1-483f-83ca-afaf4868e2f2'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.768999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] The token cache is being invalidate because project 31419abef5074839b9bc6149b3c80932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:25:45.769293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.769919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:25:45.776591 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1299/2598] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:25:45 2022] DELETE /identity/v3/projects/31419abef5074839b9bc6149b3c80932 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:25:47.380745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402427-438c-481a-becd-169f524973bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:47.381820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402427-438c-481a-becd-169f524973bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:47.382306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402427-438c-481a-becd-169f524973bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:47.397503 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:47.404652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-02402427-438c-481a-becd-169f524973bf None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:25:47.406660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-02402427-438c-481a-becd-169f524973bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:47.468156 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1300/2599] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:25:47.480717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:25:47.482096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:25:47.554000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb122c-afd1-483f-83ca-afaf4868e2f2 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:25:47.559061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:25:47.559697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:25:47.560010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:25:47.560290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:25:47.568919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:25:47.570490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:25:47.574043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:47.580630 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1300/2600] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:25:57.461224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=23 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:25:57.584589 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:01.346485 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402427-438c-481a-becd-169f524973bf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:01.348620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-02402427-438c-481a-becd-169f524973bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:01.432404 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402427-438c-481a-becd-169f524973bf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:01.436195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:01.436817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:01.437130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:01.437410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:01.439212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:01.543880 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:01.545268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:01.564402 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1301/2601] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:04.739762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:04.741181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:04.781968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6bdda-6600-4d78-b38b-feb7dc9445dd service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:04.787560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:04.788216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:04.788499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:04.788772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] PATH_INFO: `/v3/users/e117c5cc43a34179b69ac8ba1529b3a8` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:04.789943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e117c5cc43a34179b69ac8ba1529b3a8)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:04.791841 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:04.838210 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e117c5cc43a34179b69ac8ba1529b3a8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:04.844854 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e117c5cc43a34179b69ac8ba1529b3a8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:04.845511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e117c5cc43a34179b69ac8ba1529b3a8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:04.846115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e117c5cc43a34179b69ac8ba1529b3a8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:04.859083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5ff37f73-2883-4ae8-958c-1698bfca3cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e117c5cc43a34179b69ac8ba1529b3a8'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:04.872709 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1301/2602] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:26:04 2022] DELETE /identity/v3/users/e117c5cc43a34179b69ac8ba1529b3a8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:26:05.048640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.059869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aca6c4-aa72-457f-a3e1-05ccfb5406e9 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.090604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:05.117130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.117770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.118050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.118325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] PATH_INFO: `/v3/projects/19bd23a653cf4c368a47163fda224d8d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.119510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bd23a653cf4c368a47163fda224d8d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.121451 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.166930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bd23a653cf4c368a47163fda224d8d', 'request_id': 'req-401cda8e-d85e-4084-bf32-6bb83bb8d12c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:05.172668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bd23a653cf4c368a47163fda224d8d', 'request_id': 'req-401cda8e-d85e-4084-bf32-6bb83bb8d12c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:05.179680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bd23a653cf4c368a47163fda224d8d', 'request_id': 'req-401cda8e-d85e-4084-bf32-6bb83bb8d12c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:05.190631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] The token cache is being invalidate because project 19bd23a653cf4c368a47163fda224d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:26:05.191058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:05.191629 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-401cda8e-d85e-4084-bf32-6bb83bb8d12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:05.193169 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1302/2603] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:26:05 2022] DELETE /identity/v3/projects/19bd23a653cf4c368a47163fda224d8d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:26:05.198188 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.198474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.198746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.256115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:05.257324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:05.317326 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1302/2604] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:05.324979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.325269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.325548 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.345928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:05.347163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:05.355134 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1303/2605] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:05.359331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.369119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd2011-437c-41c5-9a3d-2b44fbcbcb94 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.373750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.374346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.374627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.374896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.375575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:26:05.375872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.377474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.389258 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1303/2606] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:26:05.393438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.403224 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3816a5d-452d-4759-8981-3190549e3318 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.407902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.408587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.408858 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.409136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.409797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.411954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.440165 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1304/2607] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:26:05 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:26:05.444908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.451641 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:05.455875 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e24385-6919-4676-b122-7dddfe83c24b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.516315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.516932 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.517212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.517484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.518127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.520820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.541173 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1304/2608] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:26:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:26:05.545270 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.555495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da797643-875a-4fdb-bc87-47b9b4e1d9b0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.560093 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.560694 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.560973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.561246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.561934 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.563502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.574050 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1305/2609] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:26:05.577866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.588524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf623-0f9b-4c52-9520-1a96613311ea admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.593592 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.594225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.594508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.594784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.595498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.597135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d339-85d7-4cee-b4e4-64b8abe1cf51 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.607989 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1305/2610] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:26:05.611902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.622393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bf9f9-efc7-45b7-837e-8b13a6b4023f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.626970 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.627612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.627893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.628200 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] PATH_INFO: `/v3/projects/8b791b67d5584c5fbbaf50fea34d8276/users/804d6e5eba9e42a7bf39d9c84565632b/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.642584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b791b67d5584c5fbbaf50fea34d8276, user_id=804d6e5eba9e42a7bf39d9c84565632b, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.645850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.657986 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1306/2611] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:26:05 2022] PUT /identity/v3/projects/8b791b67d5584c5fbbaf50fea34d8276/users/804d6e5eba9e42a7bf39d9c84565632b/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:26:05.663576 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bb56-001b-46a0-8648-2a47b67b237c None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.663869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bb56-001b-46a0-8648-2a47b67b237c None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.664192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165bb56-001b-46a0-8648-2a47b67b237c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.682657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5165bb56-001b-46a0-8648-2a47b67b237c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:05.683857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5165bb56-001b-46a0-8648-2a47b67b237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:05.742818 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1306/2612] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:05.752554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:05.754324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:05.811308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1408b-d970-4f2f-ba50-abb5202aef86 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:05.814992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:05.815606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:05.815892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:05.816207 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:05.826625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:05.828016 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:05.838415 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1307/2613] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:09.611650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a32-f3eb-437d-a77d-16b442628bcf None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:09.612290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a32-f3eb-437d-a77d-16b442628bcf None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:09.612290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e7a32-f3eb-437d-a77d-16b442628bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:09.643368 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-811e7a32-f3eb-437d-a77d-16b442628bcf None None] MFA Rules not processed for user `804d6e5eba9e42a7bf39d9c84565632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:09.645327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-811e7a32-f3eb-437d-a77d-16b442628bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:09.715106 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1307/2614] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:09.730622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:09.732265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:09.736216 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:09.841846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d081-4687-438e-9733-5e513cd36c5e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:09.847725 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:09.848640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:09.849010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:09.849319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:09.858101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:09.859751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:09.869720 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1308/2615] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:11.421940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:11.422470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:11.422579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:11.443298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] MFA Rules not processed for user `804d6e5eba9e42a7bf39d9c84565632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:11.444880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:11.453378 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1308/2616] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:19.865300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=45 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:21.437436 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:47.098928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:47.100579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:47.199276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6b8a-edb3-4223-b8e4-d6e681cd178a service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:47.204722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:47.205615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:47.205899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:47.206177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:47.208803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:47.222438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:47.224119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:47.235199 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1309/2617] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:50.936917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:50.938324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:50.972539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe453b8e-2c84-423b-8572-f52952c723da None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:50.976189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:50.976805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:50.977086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:50.977362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:50.979112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:50.990903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:50.992648 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:51.002406 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1309/2618] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:26:54.134785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.134785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:54.147688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c2055-15c5-48f7-9370-af97f5d91e2d service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.153090 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.153739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.154050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.154309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] PATH_INFO: `/v3/users/9857d08d4d7a46e3a377e2d60673ab80` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.155477 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9857d08d4d7a46e3a377e2d60673ab80)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.157427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.204488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9857d08d4d7a46e3a377e2d60673ab80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.214291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9857d08d4d7a46e3a377e2d60673ab80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.214834 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9857d08d4d7a46e3a377e2d60673ab80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.222467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9857d08d4d7a46e3a377e2d60673ab80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.234371 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-48faa6ad-01c0-4dd1-89ce-d7f0efb51c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9857d08d4d7a46e3a377e2d60673ab80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.240224 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1310/2619] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:26:54 2022] DELETE /identity/v3/users/9857d08d4d7a46e3a377e2d60673ab80 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:26:54.418877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.430713 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a650-c4c5-44bb-baf9-f9a20d5966f6 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.498052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.498684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.498963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.499235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] PATH_INFO: `/v3/projects/fb8ce651340a4fd7b2e42e2728e85aa1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.500430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8ce651340a4fd7b2e42e2728e85aa1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.502300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.547388 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8ce651340a4fd7b2e42e2728e85aa1', 'request_id': 'req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.553367 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8ce651340a4fd7b2e42e2728e85aa1', 'request_id': 'req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.559427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8ce651340a4fd7b2e42e2728e85aa1', 'request_id': 'req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.572359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] The token cache is being invalidate because project fb8ce651340a4fd7b2e42e2728e85aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:26:54.572720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.573271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-e4e2c4ee-7134-46e1-bb41-73759b2c7b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:26:54.574799 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1310/2620] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:26:54 2022] DELETE /identity/v3/projects/fb8ce651340a4fd7b2e42e2728e85aa1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:26:54.580182 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.580502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.580780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.600642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:54.602387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:54.640983 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:54.664521 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1311/2621] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:54.672472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.672761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.673038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.693291 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:54.694491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:54.703585 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1311/2622] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:26:54.708260 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.718524 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a4db4-4d7b-41f9-a731-ca3c1800e0fb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.723110 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.723715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.724033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.724315 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.725006 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:26:54.725313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.728692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.741675 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1312/2623] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:26:54.746617 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.756192 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d8d10-7320-46b4-8c94-d101377a6895 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.762176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.762776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.763084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.763354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.764080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.766303 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.797788 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1312/2624] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:26:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:26:54.801598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.812196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d7b8d-2c18-499f-9551-0067d1ec67cc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.868658 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.869268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.869552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.869827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.870490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.872419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.893256 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1313/2625] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:26:54 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:26:54.897466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.908964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aefe80-828c-4755-abb6-2b0a7ed6fd80 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.914272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.914973 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.915261 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.915544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.916393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.917862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.928342 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1313/2626] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:26:54.933056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.943300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d20d2-2e55-46e1-a1c2-44f1d996cb96 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.948148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.948761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.949056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.949337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:54.950032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:54.951625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388eb8-5001-4415-823e-70060daaa539 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:54.962779 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1314/2627] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:26:54.967006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:54.978744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2369503-d59e-4639-8058-44d5e9948a0f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:54.984248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:54.985004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:54.985363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:54.985712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] PATH_INFO: `/v3/projects/b1a3bb6c799a4278912a90d61991c4d1/users/2ebbd807ff494b41b9de3f8be0514c26/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:55.001912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a3bb6c799a4278912a90d61991c4d1, user_id=2ebbd807ff494b41b9de3f8be0514c26, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:55.004726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:55.006983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:26:55.018601 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1314/2628] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:26:54 2022] PUT /identity/v3/projects/b1a3bb6c799a4278912a90d61991c4d1/users/2ebbd807ff494b41b9de3f8be0514c26/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:26:55.029154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:55.029614 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:55.029985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:55.061117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] MFA Rules not processed for user `2ebbd807ff494b41b9de3f8be0514c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:26:55.062420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:55.127164 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1315/2629] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:26:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:26:55.138709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:26:55.140474 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:26:55.214528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7e98e-dd2a-4512-85a2-e2a48d85f678 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:26:55.222623 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:26:55.223393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:26:55.223774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:26:55.224185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:26:55.233250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:26:55.234820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4f815-f210-4ba5-b557-504ee3a6a96c service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:26:55.243674 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1315/2630] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:00.423043 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:00.462162 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:00.485784 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c49769-098d-4589-8c8f-506917b013b2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:00.490310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:00.490948 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:00.491230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:00.491507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] PATH_INFO: `/v3/users/2ebbd807ff494b41b9de3f8be0514c26` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:00.492974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebbd807ff494b41b9de3f8be0514c26)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:00.494894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:00.542034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebbd807ff494b41b9de3f8be0514c26'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:00.549487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebbd807ff494b41b9de3f8be0514c26'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:00.550055 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebbd807ff494b41b9de3f8be0514c26'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:00.557247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebbd807ff494b41b9de3f8be0514c26'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:00.569080 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebbd807ff494b41b9de3f8be0514c26'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:00.575298 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1316/2631] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:00 2022] DELETE /identity/v3/users/2ebbd807ff494b41b9de3f8be0514c26 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:00.580145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:00.580632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:00.580740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:00.599909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:00.601748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:00.658231 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1316/2632] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:00.668622 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:00.670119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:00.731095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae66a4e-a067-4a17-a8a9-7b6f368f5e00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:00.734761 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:00.735378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:00.735663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:00.736000 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:00.744972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:00.746392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc19f4-23b0-488b-92dc-603c360423d9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:00.755775 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1317/2633] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:01.023356 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.025685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:01.039981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16883853-ecdf-49f4-9b35-6b479d043513 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.046035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.046680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.046958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.047225 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] PATH_INFO: `/v3/projects/b1a3bb6c799a4278912a90d61991c4d1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.048504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a3bb6c799a4278912a90d61991c4d1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.050604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.099139 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a3bb6c799a4278912a90d61991c4d1', 'request_id': 'req-4312b5e5-6ade-45ab-9250-5b5bc476e0df'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:01.105317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a3bb6c799a4278912a90d61991c4d1', 'request_id': 'req-4312b5e5-6ade-45ab-9250-5b5bc476e0df'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:01.110785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a3bb6c799a4278912a90d61991c4d1', 'request_id': 'req-4312b5e5-6ade-45ab-9250-5b5bc476e0df'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:01.123333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] The token cache is being invalidate because project b1a3bb6c799a4278912a90d61991c4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:01.123615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:01.124245 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-4312b5e5-6ade-45ab-9250-5b5bc476e0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:01.125734 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1317/2634] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:01 2022] DELETE /identity/v3/projects/b1a3bb6c799a4278912a90d61991c4d1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:27:01.130643 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.130927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.131201 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.151337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:01.152640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:01.205305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:01.214827 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1318/2635] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:01.224538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.224824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.225094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.232999 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:01.248189 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:01.249418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:01.258095 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1318/2636] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:01.261879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.271487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627c53-cf44-42ea-b7f1-ee49ef01ec17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.276285 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.276890 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.277168 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.277442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.278131 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:27:01.278436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.280050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.292253 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1319/2637] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:27:01.296502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.306257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d12da-6c02-4575-8a16-85904ff3485e None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.310927 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.311527 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.311808 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.312119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.312793 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.314664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.341420 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1319/2638] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:01.345534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.356077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ded87-8cff-4422-a3d0-96cf18232683 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.539897 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.540615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.540798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.541223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.541972 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.543925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.565767 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1320/2639] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:01.570058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.581024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cdd9a-6901-47db-8d96-dccebb03b14f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.585883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.586528 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.586806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.587075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.587761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.589395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.599296 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1320/2640] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:01.604092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.614106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79203746-f793-4e2d-a265-2ed9bccdebf3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.619386 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.620027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.620313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.620593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.621287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.622861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c27035-5099-404f-bd7e-531e1efde487 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.632670 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1321/2641] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:01.636678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.646526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1756f-187c-4e95-a85d-0636149ae829 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.651359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.652038 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.652322 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.652595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] PATH_INFO: `/v3/projects/0b8b68886a454dda94139d0dce606fe0/users/30816d90ec7e4ca985b4f3ac493df7b7/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.667550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8b68886a454dda94139d0dce606fe0, user_id=30816d90ec7e4ca985b4f3ac493df7b7, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.670204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.683995 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1321/2642] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:01 2022] PUT /identity/v3/projects/0b8b68886a454dda94139d0dce606fe0/users/30816d90ec7e4ca985b4f3ac493df7b7/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:27:01.694136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.694427 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.694743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.722313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] MFA Rules not processed for user `30816d90ec7e4ca985b4f3ac493df7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:01.723545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:01.786810 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1322/2643] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:01.792240 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.856216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de164b-f096-4566-ac48-b1ea5a1fdf16 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.860896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.861502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.861786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.862061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.862726 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.864860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.891421 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1322/2644] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:01.895738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:01.906630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf0086-a56b-4d85-902a-c2d3acd0cecc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:01.955528 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:01.963530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:01.964409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:01.964697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:01.964973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:01.965630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:01.967535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:01.989091 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1323/2645] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:01 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:01.993277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.003357 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931838d4-a3e3-42d0-aff1-2b006c565bf8 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.008314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.008914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.009432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.009711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.010396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.011992 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.022271 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1323/2646] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:27:02.027308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.037474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c7230-18ec-4b77-8eed-3a70d91b6d7d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.042877 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.043531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.043819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.044428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] PATH_INFO: `/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13/users/020ff17def8f4a74b25c77058e33ce4c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.059028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba241be4332d48bebafdb1fcb0dbaa13, user_id=020ff17def8f4a74b25c77058e33ce4c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.061687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.074690 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1324/2647] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:02 2022] PUT /identity/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13/users/020ff17def8f4a74b25c77058e33ce4c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:02.078747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.090152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ba35-4e4e-499e-8d67-1da412623033 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.144299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.144833 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.145118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.145390 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.146066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.147647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85025f77-ffae-4096-84fc-cdbebc9ccd65 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.157624 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1324/2648] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:02.161801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.172801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed40d5-1d93-405f-963d-db3b182da522 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.177482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.178136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.178422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.178703 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] PATH_INFO: `/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13/users/020ff17def8f4a74b25c77058e33ce4c/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.181012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba241be4332d48bebafdb1fcb0dbaa13, user_id=020ff17def8f4a74b25c77058e33ce4c, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.183621 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.193806 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1325/2649] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:02 2022] PUT /identity/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13/users/020ff17def8f4a74b25c77058e33ce4c/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:02.204248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.204534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.205071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.224893 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:02.234348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] MFA Rules not processed for user `020ff17def8f4a74b25c77058e33ce4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:02.235551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:02.305295 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1325/2650] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:02.316798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.318510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:02.400296 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fb495-1f10-4c08-b61f-19f5123e6bd4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.403772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.404434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.404699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.404969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.414060 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.415543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.424773 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1326/2651] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:02.500382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:02.510590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231f88-16c6-43d9-af47-f6ac43848a02 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:02.514179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:02.514782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:02.515061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:02.515333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:02.573207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:02.574629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7587c58-88ea-490b-bf3a-fc735c73270f service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:02.583656 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1326/2652] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:09.349499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:09.413030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503499a-cb82-4558-9f93-40d9fbb56128 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:09.417636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:09.418282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:09.418568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:09.418846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] PATH_INFO: `/v3/users/30816d90ec7e4ca985b4f3ac493df7b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:09.420062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30816d90ec7e4ca985b4f3ac493df7b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:09.421965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:09.456295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:09.470448 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30816d90ec7e4ca985b4f3ac493df7b7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:09.477824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30816d90ec7e4ca985b4f3ac493df7b7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:09.478506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30816d90ec7e4ca985b4f3ac493df7b7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:09.485258 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30816d90ec7e4ca985b4f3ac493df7b7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:09.496985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30816d90ec7e4ca985b4f3ac493df7b7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:09.502755 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1327/2653] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:09 2022] DELETE /identity/v3/users/30816d90ec7e4ca985b4f3ac493df7b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:09.507411 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:09.509128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:09.509128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:09.528022 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:09.529224 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:09.587408 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1327/2654] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:09.597213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:09.598630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:09.655186 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf52b9-1ad8-4447-a918-5c8f008e882b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:09.658859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:09.659478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:09.659762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:09.660068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:09.670916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:09.672385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:09.682235 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1328/2655] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:09.947135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:09.948632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:09.963208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38834d3e-4c8c-4c4c-bac0-44ff0a2bfb00 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:09.968086 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:09.969072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:09.969361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:09.969639 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] PATH_INFO: `/v3/projects/0b8b68886a454dda94139d0dce606fe0` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:09.970810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8b68886a454dda94139d0dce606fe0)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:09.972855 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.004694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:10.020677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8b68886a454dda94139d0dce606fe0', 'request_id': 'req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.026959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8b68886a454dda94139d0dce606fe0', 'request_id': 'req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.032521 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8b68886a454dda94139d0dce606fe0', 'request_id': 'req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.047091 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] The token cache is being invalidate because project 0b8b68886a454dda94139d0dce606fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:10.047720 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.048382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.049908 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1328/2656] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:09 2022] DELETE /identity/v3/projects/0b8b68886a454dda94139d0dce606fe0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:10.053843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.064323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b4d50-d49c-4f64-b195-ac818019725b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.122322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.122951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.123229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.123500 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] PATH_INFO: `/v3/users/020ff17def8f4a74b25c77058e33ce4c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.124680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] RBAC: Authorizing `identity:delete_user(user_id=020ff17def8f4a74b25c77058e33ce4c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.126561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.170612 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020ff17def8f4a74b25c77058e33ce4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.177644 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020ff17def8f4a74b25c77058e33ce4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.178250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020ff17def8f4a74b25c77058e33ce4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.179428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:10.187531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020ff17def8f4a74b25c77058e33ce4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.199674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-44cf9bc7-2c02-40b4-a85e-f9b8b4dcebec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020ff17def8f4a74b25c77058e33ce4c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.205740 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1329/2657] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:10 2022] DELETE /identity/v3/users/020ff17def8f4a74b25c77058e33ce4c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:10.488524 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.490190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:10.504496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab8645-9b69-4572-b1b3-df9afc6bd0ed admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.563159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.563724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.564044 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.564320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] PATH_INFO: `/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.565499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba241be4332d48bebafdb1fcb0dbaa13)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.567392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.615093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba241be4332d48bebafdb1fcb0dbaa13', 'request_id': 'req-890f31c1-9fa5-480a-ba43-bb0e5142762a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.621555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba241be4332d48bebafdb1fcb0dbaa13', 'request_id': 'req-890f31c1-9fa5-480a-ba43-bb0e5142762a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.627093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba241be4332d48bebafdb1fcb0dbaa13', 'request_id': 'req-890f31c1-9fa5-480a-ba43-bb0e5142762a'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.640300 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] The token cache is being invalidate because project ba241be4332d48bebafdb1fcb0dbaa13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:10.640590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.641203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-890f31c1-9fa5-480a-ba43-bb0e5142762a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:10.642704 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1329/2658] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:10 2022] DELETE /identity/v3/projects/ba241be4332d48bebafdb1fcb0dbaa13 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:10.647608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.648120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.648217 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.668367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:10.669569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:10.732258 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1330/2659] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:10.741364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.741650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.741929 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.761552 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:10.762744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:10.770622 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1330/2660] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:10.775436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.785245 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f693252-8dea-482f-b4eb-c30d54aac911 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.790586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.791192 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.791474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.791756 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.792492 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:27:10.792797 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.794383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.806307 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1331/2661] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 31 01:27:10.810716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.819961 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b166c-b595-4ef4-980a-f9ba8dd0e639 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.825075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.825666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.825942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.826214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.826866 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.828784 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.855620 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1331/2662] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:10 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:10.859951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.869781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2e53d-7e10-459a-bfb3-5cf6f2e31eaa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.925697 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.926313 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.926597 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.926874 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.930969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.932968 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.958021 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1332/2663] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:10 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:10.962980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:10.973498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1eb7-9833-42e6-8351-cc7914b6c891 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:10.978511 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:10.979116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:10.979394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:10.979669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:10.980405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:10.981985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:10.992503 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1332/2664] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:10.996682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.006887 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9426a0-0dce-4052-90b4-0a76ca6dbe18 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.012631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.013248 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.013530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.013805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.014499 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.016138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa3b3d-e65d-422b-8f75-cf02aba52219 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.027425 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1333/2665] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:11.031637 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.041892 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e888bf-cf39-4f8f-90c7-2a472597459d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.046496 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.047142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.047422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.047695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] PATH_INFO: `/v3/projects/ac59e39e1c534b109aecb8f75125a425/users/7d06ce28343645c6abac701aa76cf43c/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.049898 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:11.064596 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac59e39e1c534b109aecb8f75125a425, user_id=7d06ce28343645c6abac701aa76cf43c, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.067203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.080751 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1333/2666] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:11 2022] PUT /identity/v3/projects/ac59e39e1c534b109aecb8f75125a425/users/7d06ce28343645c6abac701aa76cf43c/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:11.092298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.092591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.092862 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.119319 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] MFA Rules not processed for user `7d06ce28343645c6abac701aa76cf43c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:11.120560 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:11.146712 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:11.186280 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1334/2667] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:11.190717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.254173 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de919877-6f57-464c-b95b-7d9926007a65 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.259446 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.260208 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.260491 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.260765 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.261418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.263299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.288840 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1334/2668] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:11 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:11.293516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.303997 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc44654-11d8-47ce-9dcb-40b87b303f53 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.359830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.360399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.360681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.360958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.361616 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.363512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.385679 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1335/2669] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:11 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:11.389755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.400198 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f443e3-8855-45d4-b21f-e670075ff605 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.404849 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.405456 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.405740 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.406016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.406702 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.408359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.418697 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1335/2670] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:11.422794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.437919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab41d17-d851-4e69-806c-126cba8f1f9d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.442736 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.443402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.443688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.444001 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] PATH_INFO: `/v3/projects/54da845e67f247bc95a2b71ba1cc8d35/users/933fb3229f5047709364675eeba8b969/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.459898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54da845e67f247bc95a2b71ba1cc8d35, user_id=933fb3229f5047709364675eeba8b969, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.462966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.475670 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1336/2671] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:11 2022] PUT /identity/v3/projects/54da845e67f247bc95a2b71ba1cc8d35/users/933fb3229f5047709364675eeba8b969/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:11.479901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.489905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9b8ba-b55a-43bf-ab6b-98cdf903045a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.546419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.547026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.547298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.547574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.548310 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.549905 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbc82a-d03c-4aaa-b0c5-b023eb2ee2c5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.560222 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1336/2672] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:11.564496 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.575387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449310-329f-4e7f-9986-c442968a1266 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.580276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.580931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.581212 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.581484 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] PATH_INFO: `/v3/projects/54da845e67f247bc95a2b71ba1cc8d35/users/933fb3229f5047709364675eeba8b969/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.583428 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54da845e67f247bc95a2b71ba1cc8d35, user_id=933fb3229f5047709364675eeba8b969, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.586052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.596512 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1337/2673] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:11 2022] PUT /identity/v3/projects/54da845e67f247bc95a2b71ba1cc8d35/users/933fb3229f5047709364675eeba8b969/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:27:11.608572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.609090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.609196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.637844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] MFA Rules not processed for user `933fb3229f5047709364675eeba8b969`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:11.638981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:11.679540 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:11.707162 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1337/2674] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:11 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:11.718459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.720238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:11.776630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5ba6-cb1e-49ac-8f03-8a82e97241e8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.780233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.780838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.781116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.781393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.790722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.792259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.801441 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1338/2675] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:11 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:11.876584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:11.886689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3924b6-88d0-4bc6-9553-7b2d40c181f8 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:11.890412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:11.890955 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:11.891239 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:11.891517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:11.948910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:11.950346 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18818c8-1912-47df-8610-c44fae12b399 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:11.959413 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1338/2676] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:11 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:21.797466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:21.955363 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=38 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:26.733916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:26.796190 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fa5ac-bc9d-4eee-a587-311f825440b3 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:26.800707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:26.801610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:26.801892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:26.802160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] PATH_INFO: `/v3/users/7d06ce28343645c6abac701aa76cf43c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:26.803312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d06ce28343645c6abac701aa76cf43c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:26.805459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:26.850955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d06ce28343645c6abac701aa76cf43c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:26.858116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d06ce28343645c6abac701aa76cf43c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:26.858739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d06ce28343645c6abac701aa76cf43c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:26.865495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d06ce28343645c6abac701aa76cf43c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:26.877373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d06ce28343645c6abac701aa76cf43c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:26.883736 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1339/2677] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:26 2022] DELETE /identity/v3/users/7d06ce28343645c6abac701aa76cf43c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:26.888343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:26.888815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:26.888912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:26.908248 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:26.909458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:26.968436 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1339/2678] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:26.978137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:26.979517 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:27.039653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cd6c2-9311-471d-b00e-5cf2a0a411b2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:27.043388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:27.044046 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:27.044333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:27.044606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:27.053555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:27.056092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:27.065452 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1340/2679] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:27.329185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:27.331054 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:27.345714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29f76b-cc8d-42f2-ae37-55ff2e50aaa6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:27.350376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:27.351651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:27.352211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:27.352538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] PATH_INFO: `/v3/projects/ac59e39e1c534b109aecb8f75125a425` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:27.353804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac59e39e1c534b109aecb8f75125a425)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:27.355724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:27.402377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac59e39e1c534b109aecb8f75125a425', 'request_id': 'req-088b070a-7252-442e-b695-dbf5a7eced71'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.408461 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac59e39e1c534b109aecb8f75125a425', 'request_id': 'req-088b070a-7252-442e-b695-dbf5a7eced71'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.414923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac59e39e1c534b109aecb8f75125a425', 'request_id': 'req-088b070a-7252-442e-b695-dbf5a7eced71'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.427569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] The token cache is being invalidate because project ac59e39e1c534b109aecb8f75125a425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:27.427860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.428518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.430601 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1340/2680] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:27 2022] DELETE /identity/v3/projects/ac59e39e1c534b109aecb8f75125a425 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:27.434648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:27.444691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca484bb-974c-4cc8-8376-3d20a76aa4e0 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:27.463408 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:27.503238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:27.503801 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:27.504121 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:27.504400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] PATH_INFO: `/v3/users/933fb3229f5047709364675eeba8b969` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:27.505555 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=933fb3229f5047709364675eeba8b969)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:27.507683 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:27.554664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933fb3229f5047709364675eeba8b969'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.562494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933fb3229f5047709364675eeba8b969'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.563312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933fb3229f5047709364675eeba8b969'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.570155 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933fb3229f5047709364675eeba8b969'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.582278 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a1686e3-8c2e-4d6f-9002-9edc6ea5e5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933fb3229f5047709364675eeba8b969'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.588141 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1341/2681] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:27 2022] DELETE /identity/v3/users/933fb3229f5047709364675eeba8b969 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:27.857070 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:27.858535 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:27.873634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b070a-7252-442e-b695-dbf5a7eced71 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:27.933011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:27.933674 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:27.933936 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:27.934215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] PATH_INFO: `/v3/projects/54da845e67f247bc95a2b71ba1cc8d35` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:27.935375 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54da845e67f247bc95a2b71ba1cc8d35)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:27.937313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:27.967323 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:27.984643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54da845e67f247bc95a2b71ba1cc8d35', 'request_id': 'req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.990817 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54da845e67f247bc95a2b71ba1cc8d35', 'request_id': 'req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:27.996526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54da845e67f247bc95a2b71ba1cc8d35', 'request_id': 'req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:28.008362 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] The token cache is being invalidate because project 54da845e67f247bc95a2b71ba1cc8d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:28.009228 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:28.009853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-fb8ae19f-b30e-4b9b-9b9a-566fc0f86a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:28.011329 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1341/2682] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:27 2022] DELETE /identity/v3/projects/54da845e67f247bc95a2b71ba1cc8d35 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:28.016387 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.016838 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.016952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.037848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:28.040154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:28.099617 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1342/2683] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:28.107907 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.108229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.108510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.128324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:28.129539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:28.138596 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1342/2684] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:28.142957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.153292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bffeef-5b1f-4fc7-8744-65c32cf82d81 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.157799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.158401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.158680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.158954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.159636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:27:28.159957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.161539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.173136 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1343/2685] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:27:28.177358 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.186887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3260-57c5-4837-b0ca-d5e2c2ee5f66 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.191523 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.192152 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.192437 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.192712 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.193365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.195752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.223775 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1343/2686] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:28.227925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.238076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4df9a-a182-499f-ac29-eef1c94b870c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.263961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:28.296490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.297026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.297305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.297578 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.298239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.300144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.321123 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1344/2687] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:27:28.325316 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.336529 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfbee5-be3a-4c7a-b77f-26ef7d8b3e2e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.341220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.341828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.342114 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.342393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.343083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.344722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.354824 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1344/2688] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:28.358573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.368476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b049a2-8fe5-4c79-aa90-52adaca6b653 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.373053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.373647 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.373928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.374204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.374886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.376984 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed1d28-9b78-477b-a242-169fbc1b5fe0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.387819 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1345/2689] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:28.391802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.402432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f192e5-d61b-4fe1-8514-6a89567ed259 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.407124 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.407777 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.408131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.408412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] PATH_INFO: `/v3/projects/a19b41a456424dd3962a46f558379a3c/users/a36f876df6004ec98b24b3b99dad54cc/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.422690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19b41a456424dd3962a46f558379a3c, user_id=a36f876df6004ec98b24b3b99dad54cc, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.425620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.440543 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1345/2690] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:28 2022] PUT /identity/v3/projects/a19b41a456424dd3962a46f558379a3c/users/a36f876df6004ec98b24b3b99dad54cc/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:28.452722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.453018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.453324 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.482134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] MFA Rules not processed for user `a36f876df6004ec98b24b3b99dad54cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:28.483369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:28.547524 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1346/2691] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:28.551888 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.613666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91112-9732-4034-9e4f-313801622570 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.619459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.620096 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.620378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.620653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.621314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.623196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.649147 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1346/2692] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:28.653348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.663700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024927e-8548-46f3-a6da-e8b072776d80 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.719111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.719721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.720039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.720316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.720973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.722865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.744361 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1347/2693] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:28.748432 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.760466 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999d65-c2cb-4a00-9d72-8f613c3adad0 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.765234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.765845 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.766128 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.766405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.767093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.768752 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.780350 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1347/2694] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:28.784565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.794335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f982f8-d846-4411-a681-c18649ba8e08 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.798864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.799504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.799795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.800106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] PATH_INFO: `/v3/projects/bc3b931291ae48ceb402259aadaf5d73/users/afe1a75cfed24793952282a336232759/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.816273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3b931291ae48ceb402259aadaf5d73, user_id=afe1a75cfed24793952282a336232759, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.818914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.833543 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1348/2695] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:28 2022] PUT /identity/v3/projects/bc3b931291ae48ceb402259aadaf5d73/users/afe1a75cfed24793952282a336232759/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:28.838073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.847844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5a9ae-835c-4662-b90e-e1138e6d89b5 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.869159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:28.907430 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.908072 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.908359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.908717 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.909321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.910985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b786a-c123-4dbf-b35d-a8e3b802ad43 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.922325 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1348/2696] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:28.926893 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:28.933414 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:28.939720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c43b-7cb8-4fba-a09d-8a3e3087efb5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:28.945227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:28.945894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.946177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.946453 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] PATH_INFO: `/v3/projects/bc3b931291ae48ceb402259aadaf5d73/users/afe1a75cfed24793952282a336232759/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:28.948431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3b931291ae48ceb402259aadaf5d73, user_id=afe1a75cfed24793952282a336232759, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:28.951035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:28.962228 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1349/2697] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:28 2022] PUT /identity/v3/projects/bc3b931291ae48ceb402259aadaf5d73/users/afe1a75cfed24793952282a336232759/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:28.972268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:28.972798 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:28.972912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:29.007699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] MFA Rules not processed for user `afe1a75cfed24793952282a336232759`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:29.008938 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:29.076644 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1349/2698] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:29.087595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:29.089476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:29.146811 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6868c0-f415-48d6-b4c8-d8d1e3d70ece admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:29.150963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:29.151576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:29.151859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:29.152165 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:29.208272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:29.209691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:29.219758 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1350/2699] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:31.773415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:31.783203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01deac-5711-4b9a-a899-e12afab4994a None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:31.786701 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:31.787301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:31.787579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:31.787852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:31.796844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:31.798249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe86df-7407-42e0-8a86-fb2f042c49c7 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:31.808403 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1350/2700] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:39.214966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:41.803351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=58 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:44.281562 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:44.348147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab5bbc-1230-4e24-b5d1-73feecfaebd1 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:44.353251 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:44.353896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:44.354177 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:44.354450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] PATH_INFO: `/v3/users/a36f876df6004ec98b24b3b99dad54cc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:44.355661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36f876df6004ec98b24b3b99dad54cc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:44.357911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:44.407650 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36f876df6004ec98b24b3b99dad54cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.415380 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36f876df6004ec98b24b3b99dad54cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.416065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36f876df6004ec98b24b3b99dad54cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.423072 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36f876df6004ec98b24b3b99dad54cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.448050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36f876df6004ec98b24b3b99dad54cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.454357 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1351/2701] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:44 2022] DELETE /identity/v3/users/a36f876df6004ec98b24b3b99dad54cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:44.459234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:44.459750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:44.459862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:44.478587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:44.480021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:44.540563 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1351/2702] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:44.550126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:44.551573 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:44.614924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211470ab-5644-408a-adb7-9589ad50b578 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:44.619246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:44.619863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:44.620187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:44.620461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:44.630379 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:44.632164 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:44.642704 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1352/2703] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:44.911895 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:44.914564 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:44.930298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8c13-a714-4baf-a15c-3d352a93a0eb None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:44.936353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:44.936983 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:44.937271 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:44.937551 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] PATH_INFO: `/v3/projects/a19b41a456424dd3962a46f558379a3c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:44.938956 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19b41a456424dd3962a46f558379a3c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:44.940947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:44.991394 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19b41a456424dd3962a46f558379a3c', 'request_id': 'req-2ecd0181-0ce2-4016-bdce-ec462522b1e1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:44.997743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19b41a456424dd3962a46f558379a3c', 'request_id': 'req-2ecd0181-0ce2-4016-bdce-ec462522b1e1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.003802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19b41a456424dd3962a46f558379a3c', 'request_id': 'req-2ecd0181-0ce2-4016-bdce-ec462522b1e1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.017595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] The token cache is being invalidate because project a19b41a456424dd3962a46f558379a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:45.017883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.018505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-2ecd0181-0ce2-4016-bdce-ec462522b1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.020067 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1352/2704] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:44 2022] DELETE /identity/v3/projects/a19b41a456424dd3962a46f558379a3c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:27:45.024715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.035132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f268c46-0f91-4328-ae00-3620657d63d5 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.053981 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:45.095126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.095770 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.096082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.096359 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] PATH_INFO: `/v3/users/afe1a75cfed24793952282a336232759` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.097522 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe1a75cfed24793952282a336232759)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.099465 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.146507 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe1a75cfed24793952282a336232759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.154239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe1a75cfed24793952282a336232759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.155033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe1a75cfed24793952282a336232759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.162452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe1a75cfed24793952282a336232759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.181247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe1a75cfed24793952282a336232759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.182748 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.183039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.183320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.183538 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1353/2705] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:45 2022] DELETE /identity/v3/users/afe1a75cfed24793952282a336232759 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:45.204451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] MFA Rules not processed for user `804d6e5eba9e42a7bf39d9c84565632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:45.205953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.268254 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1353/2706] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:45.475021 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.477929 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.551741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d870c0-1337-4576-94fe-3e27073c8372 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.556561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.557214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.557498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.557777 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] PATH_INFO: `/v3/projects/bc3b931291ae48ceb402259aadaf5d73` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.558953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3b931291ae48ceb402259aadaf5d73)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.560909 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.594376 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.595918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.608097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:45.611590 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3b931291ae48ceb402259aadaf5d73', 'request_id': 'req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.618403 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3b931291ae48ceb402259aadaf5d73', 'request_id': 'req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.626287 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3b931291ae48ceb402259aadaf5d73', 'request_id': 'req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.632755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:45.639400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] The token cache is being invalidate because project bc3b931291ae48ceb402259aadaf5d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:45.639692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.640372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dfcb96ed-29d9-45f5-b3cd-d7a8bbd6df1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:45.641891 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1354/2707] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:45 2022] DELETE /identity/v3/projects/bc3b931291ae48ceb402259aadaf5d73 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:45.646763 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd0ec-7480-4db6-8614-37ae2365ffcb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.647052 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd0ec-7480-4db6-8614-37ae2365ffcb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.647998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd0ec-7480-4db6-8614-37ae2365ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.662763 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcf001-ce29-436b-9173-226339be7e69 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.667274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-815fd0ec-7480-4db6-8614-37ae2365ffcb None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:45.668538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-815fd0ec-7480-4db6-8614-37ae2365ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.713427 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.714153 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.714505 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.714861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.716783 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.726584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.728135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.729401 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1355/2708] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:27:45.737342 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1354/2709] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:27:45.737520 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.737688 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.737962 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.758624 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:45.759826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:45.767707 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1356/2710] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:27:45.771963 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.783366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc37c8-650c-43d3-9748-2861541d1903 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.787979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.788789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.789073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.789345 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.790034 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:27:45.790331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.791925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.804614 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1355/2711] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:27:45.808375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.817679 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e8ca-eed6-48aa-9c9d-fbac0a12aa6d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.823402 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.824065 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.824378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.824662 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.825349 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.827243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.855201 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1357/2712] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:45 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:27:45.859364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.869944 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af00b2-f715-4862-ba59-f8635f4bb314 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.929134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.929880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.930161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.930434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.931103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.933101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.955956 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1356/2713] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:45 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:45.960422 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:45.970902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573883e-3e7c-4904-a23e-cc6e6bd024ec admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:45.976323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:45.976944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:45.977232 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:45.977511 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:45.978209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:45.979832 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:45.991464 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1358/2714] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:27:45.995785 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.007530 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fb912-59f3-45c2-8463-aad13a626ad9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.012738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.013356 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.013645 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.013923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.014619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.016264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bb08d-38f4-414e-85b7-81b59498c4ea admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.028508 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1357/2715] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:46.032716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.042956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07779952-47b9-42fb-ab45-cc3b983d8f82 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.047535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.048213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.048491 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.048765 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] PATH_INFO: `/v3/projects/fbd206e71dc04bf19832fd42d6496f2f/users/d5bd68e67a154b81a1c7254c9ed466af/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.063852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd206e71dc04bf19832fd42d6496f2f, user_id=d5bd68e67a154b81a1c7254c9ed466af, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.066521 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.079713 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1359/2716] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:46 2022] PUT /identity/v3/projects/fbd206e71dc04bf19832fd42d6496f2f/users/d5bd68e67a154b81a1c7254c9ed466af/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:46.147694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.148010 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.148290 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.175959 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] MFA Rules not processed for user `d5bd68e67a154b81a1c7254c9ed466af`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:46.177099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:46.217754 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:46.242407 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1358/2717] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:46.246918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.306645 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b999dc-42f6-4fea-bab5-2e326ada5280 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.311238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.311843 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.312151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.312429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.313079 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.314965 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.329196 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:46.342573 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1360/2718] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:46 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:46.346591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.358150 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fe700-e74c-4181-93fa-ff1325c08399 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.413431 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.414042 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.414327 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.414602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.415268 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.417212 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.439311 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1359/2719] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:46 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:46.443478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.453907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376801-bdbe-4ee3-993a-3700e12bca75 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.458805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.459411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.460305 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.460589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.461280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.462864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.473615 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1361/2720] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:46.478314 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.488257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74c218-7a6f-4ea9-98b2-6118535a01de admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.492937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.493590 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.493872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.494164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] PATH_INFO: `/v3/projects/0e56f95687c4436f830de91e8a31d53c/users/cfbdfe9e739f4655965841105c87e987/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.511719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e56f95687c4436f830de91e8a31d53c, user_id=cfbdfe9e739f4655965841105c87e987, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.514429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.528117 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1360/2721] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:46 2022] PUT /identity/v3/projects/0e56f95687c4436f830de91e8a31d53c/users/cfbdfe9e739f4655965841105c87e987/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:46.532187 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.543083 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce542-cc65-4900-bdbe-b90c831342dc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.599833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.601118 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.601636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.601924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.602620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.604229 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67608989-b42a-4e2f-ae4c-d63318d40664 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.613933 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1362/2722] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:46.618354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.629686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe94a6b-80ec-4705-8498-9f5c08ec7743 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.634429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.635095 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.635377 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.635655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] PATH_INFO: `/v3/projects/0e56f95687c4436f830de91e8a31d53c/users/cfbdfe9e739f4655965841105c87e987/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.637662 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e56f95687c4436f830de91e8a31d53c, user_id=cfbdfe9e739f4655965841105c87e987, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.640332 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.651493 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1361/2723] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:46 2022] PUT /identity/v3/projects/0e56f95687c4436f830de91e8a31d53c/users/cfbdfe9e739f4655965841105c87e987/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:46.661863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.662154 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.662437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.690952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] MFA Rules not processed for user `cfbdfe9e739f4655965841105c87e987`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:46.692209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:46.759749 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1363/2724] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:46.770301 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:46.772056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:46.830414 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df06a0-3cb5-46fe-bf11-c701201c28be admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:46.834103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:46.835424 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:46.835718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:46.836025 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:46.844978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:46.846419 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae877cc-6472-4268-9c66-7af1690ab852 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:46.855868 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1362/2725] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:47.439097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:47.501417 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900283-7152-47c0-ad3d-02d341dc2c0d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:47.505961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:47.507163 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:47.507561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:47.507849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] PATH_INFO: `/v3/users/d5bd68e67a154b81a1c7254c9ed466af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:47.509068 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bd68e67a154b81a1c7254c9ed466af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:47.511036 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:47.515534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:47.559171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bd68e67a154b81a1c7254c9ed466af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:47.566282 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bd68e67a154b81a1c7254c9ed466af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:47.566900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bd68e67a154b81a1c7254c9ed466af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:47.574458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bd68e67a154b81a1c7254c9ed466af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:47.586762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bd68e67a154b81a1c7254c9ed466af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:47.592620 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1364/2726] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:47 2022] DELETE /identity/v3/users/d5bd68e67a154b81a1c7254c9ed466af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:47.597113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:47.597404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:47.597683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:47.617423 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:47.618643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:47.650429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:47.677782 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1363/2727] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:47.688141 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:47.689660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:47.746008 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10167148-567a-429d-9361-25c8b8374d68 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:47.749640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:47.750247 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:47.750530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:47.750825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:47.759788 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:47.761290 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:47.770608 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1365/2728] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:48.036967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.039103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:48.057885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a364e5-9fa8-40df-91a0-962fbdbd592d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:48.077024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:48.077685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.077966 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.078279 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] PATH_INFO: `/v3/projects/fbd206e71dc04bf19832fd42d6496f2f` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.079458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd206e71dc04bf19832fd42d6496f2f)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:48.081672 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:48.130666 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd206e71dc04bf19832fd42d6496f2f', 'request_id': 'req-c1388219-1a25-4ed1-b62f-bfba7bfaf963'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.137769 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd206e71dc04bf19832fd42d6496f2f', 'request_id': 'req-c1388219-1a25-4ed1-b62f-bfba7bfaf963'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.143727 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd206e71dc04bf19832fd42d6496f2f', 'request_id': 'req-c1388219-1a25-4ed1-b62f-bfba7bfaf963'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.158324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] The token cache is being invalidate because project fbd206e71dc04bf19832fd42d6496f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:48.158616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.159265 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.161045 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1364/2729] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:48 2022] DELETE /identity/v3/projects/fbd206e71dc04bf19832fd42d6496f2f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:48.165762 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.176148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3eb53-91ef-4d6e-be40-9b5dea1960da service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:48.236208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:48.236852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.237134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.237413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] PATH_INFO: `/v3/users/cfbdfe9e739f4655965841105c87e987` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.238582 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbdfe9e739f4655965841105c87e987)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:48.240539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:48.268007 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:48.287407 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbdfe9e739f4655965841105c87e987'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.295147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbdfe9e739f4655965841105c87e987'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.295790 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbdfe9e739f4655965841105c87e987'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.302674 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbdfe9e739f4655965841105c87e987'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.314373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-afd76e12-81ee-4249-ad8e-3391d6f3f155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbdfe9e739f4655965841105c87e987'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.320722 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1366/2730] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:27:48 2022] DELETE /identity/v3/users/cfbdfe9e739f4655965841105c87e987 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:48.584343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.585809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:48.599472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388219-1a25-4ed1-b62f-bfba7bfaf963 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:48.657796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:48.658475 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.658699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.658970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] PATH_INFO: `/v3/projects/0e56f95687c4436f830de91e8a31d53c` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.660134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e56f95687c4436f830de91e8a31d53c)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:48.662026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:48.714877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e56f95687c4436f830de91e8a31d53c', 'request_id': 'req-580ca806-ed02-497e-b540-30b42bd6d49d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.720985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e56f95687c4436f830de91e8a31d53c', 'request_id': 'req-580ca806-ed02-497e-b540-30b42bd6d49d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.727378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e56f95687c4436f830de91e8a31d53c', 'request_id': 'req-580ca806-ed02-497e-b540-30b42bd6d49d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.729069 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:48.741917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] The token cache is being invalidate because project 0e56f95687c4436f830de91e8a31d53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:27:48.742205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.742822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-580ca806-ed02-497e-b540-30b42bd6d49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:27:48.744373 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1365/2731] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:27:48 2022] DELETE /identity/v3/projects/0e56f95687c4436f830de91e8a31d53c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:48.749239 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.749722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.749830 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.769826 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:48.771040 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:48.829212 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1367/2732] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:48.837732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.838024 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.838305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.859077 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:48.860313 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:48.868534 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1366/2733] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:48.872707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.882591 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe3109-3157-4482-93a8-bb209ff00bdf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:48.887174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:48.887809 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.888144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.888424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.889147 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:27:48.889457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:48.891058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:48.903038 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1368/2734] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:27:48.907103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.917011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c5038-dbf7-41b5-99fe-c314421d63a6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:48.921685 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:48.922282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:48.922571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:48.922846 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:48.923497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:48.925440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:48.952904 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1367/2735] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:27:48 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:48.957373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:48.968502 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4bd7b-0cbd-434e-98bc-3ef12b1965ee admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:49.024454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:49.025081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.025365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.025640 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.026344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:49.028292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:49.050453 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1369/2736] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:27:48 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:27:49.054234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:49.064852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c6fc-6bc4-4166-8815-a4aa9765855a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:49.070052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:49.070663 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.070946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.071223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.071912 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:49.073536 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:49.084195 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1368/2737] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:49.088751 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:49.098716 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49617f-25c2-4f51-b994-2e7299b63dc2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:49.103753 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:49.104396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.104680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.104958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.105649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:49.107221 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52977d55-90f0-43e1-ba2b-b9e3a0fc3c69 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:49.117966 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1370/2738] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:27:49.122122 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:49.133146 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14541-9cc4-405a-8798-7bd666d7ce9d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:49.137942 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:49.138601 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.138885 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.139161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] PATH_INFO: `/v3/projects/7f04a169dc12474ebdc3f859dd5a6679/users/2117f37d550e44aeb57b7436fbbe9d65/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.154258 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f04a169dc12474ebdc3f859dd5a6679, user_id=2117f37d550e44aeb57b7436fbbe9d65, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:49.156910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:49.172871 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1369/2739] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:27:49 2022] PUT /identity/v3/projects/7f04a169dc12474ebdc3f859dd5a6679/users/2117f37d550e44aeb57b7436fbbe9d65/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:27:49.184535 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.184827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.185106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.207431 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:49.219513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] MFA Rules not processed for user `2117f37d550e44aeb57b7436fbbe9d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:27:49.221106 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:49.301569 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1371/2740] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:27:49.313191 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:27:49.314899 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:27:49.373080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac367d-1b37-48eb-9331-ebd04db1f8c7 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:27:49.376704 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:27:49.377321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:27:49.377604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:27:49.377883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:27:49.387196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:27:49.388650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6741f-67ab-4fc6-a779-53a4b26251f8 service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:27:49.398254 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1370/2741] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:27:59.295095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=27 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:27:59.393396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=55 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:16.416181 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:16.488255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e384989-aa65-43c4-b84d-b777c4b94f4e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:16.493637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:16.494277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:16.494556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:16.494831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] PATH_INFO: `/v3/users/2117f37d550e44aeb57b7436fbbe9d65` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:16.496031 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2117f37d550e44aeb57b7436fbbe9d65)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:16.497943 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:16.546873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2117f37d550e44aeb57b7436fbbe9d65'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:16.555020 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2117f37d550e44aeb57b7436fbbe9d65'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:16.555638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2117f37d550e44aeb57b7436fbbe9d65'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:16.563847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2117f37d550e44aeb57b7436fbbe9d65'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:16.576272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2117f37d550e44aeb57b7436fbbe9d65'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:16.582656 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1372/2742] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:28:16 2022] DELETE /identity/v3/users/2117f37d550e44aeb57b7436fbbe9d65 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:16.588000 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:16.588534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:16.588534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:16.607716 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:16.608979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:16.670752 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1371/2743] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:28:16.680378 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:16.681867 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:16.740888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296feaf2-1eff-44e7-8a0b-e8ae7f3269e7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:16.744568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:16.745183 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:16.745466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:16.745742 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:16.754687 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:16.756127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb13c3c-63c9-49b8-bbac-98c7b7dfd4b8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:16.766100 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1373/2744] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:17.035326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.036981 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:17.050691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeaabb-f488-482b-8a19-038824315f3f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.056707 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.057360 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.057998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.058277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] PATH_INFO: `/v3/projects/7f04a169dc12474ebdc3f859dd5a6679` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.059453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f04a169dc12474ebdc3f859dd5a6679)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.061870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.110052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f04a169dc12474ebdc3f859dd5a6679', 'request_id': 'req-7675d156-7ced-4610-b51d-666c4a97b4c9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:17.116781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f04a169dc12474ebdc3f859dd5a6679', 'request_id': 'req-7675d156-7ced-4610-b51d-666c4a97b4c9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:17.122582 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f04a169dc12474ebdc3f859dd5a6679', 'request_id': 'req-7675d156-7ced-4610-b51d-666c4a97b4c9'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:17.135689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] The token cache is being invalidate because project 7f04a169dc12474ebdc3f859dd5a6679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:28:17.136006 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:17.136619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-7675d156-7ced-4610-b51d-666c4a97b4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:17.138093 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1372/2745] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:28:17 2022] DELETE /identity/v3/projects/7f04a169dc12474ebdc3f859dd5a6679 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:17.142989 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.143283 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.143567 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.164102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:17.165353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:17.182510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:17.228334 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1374/2746] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:17.236331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.236627 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.236910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.256747 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:17.257960 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:17.265873 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1373/2747] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:17.270091 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.279668 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f45d9-c7d2-46ac-9514-98a126733f93 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.284228 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.284823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.285098 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.285367 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.286369 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:28:17.286682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.288836 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.300102 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1375/2748] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:28:17.305113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.314382 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22623bee-6ccd-42f3-8c8d-caedf52ac831 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.319141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.319919 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.320229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.320502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.321159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.323094 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.359423 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1374/2749] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:28:17 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:28:17.363745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.374705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8d40-a1b7-448c-8058-14fa7d18a892 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.430915 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.431572 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.431804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.432109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.432781 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.435005 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.457004 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1376/2750] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:28:17 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:28:17.461206 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.471502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2fc48-33d0-4d49-89ce-8540bf948eb6 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.476851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.477451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.477732 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.478003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.478772 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.480361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.490118 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1375/2751] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:17.494711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.504545 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41634b0-a2d8-46d2-bce4-7d669f17331b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.509318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.509904 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.510184 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.510458 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.511138 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.512748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabcf66-788f-4232-a7fb-86afdd2f45c1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.523796 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1377/2752] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:17.527705 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.537534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02939c2c-4501-406f-9038-900b4ca1bed1 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.542632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.543276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.543557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.543829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] PATH_INFO: `/v3/projects/b1d70347c79a4d7db195b2e9683958e1/users/d7d56025d3cc490baae1b8d8e0b68f29/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.558465 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d70347c79a4d7db195b2e9683958e1, user_id=d7d56025d3cc490baae1b8d8e0b68f29, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.561131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.574760 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1376/2753] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:28:17 2022] PUT /identity/v3/projects/b1d70347c79a4d7db195b2e9683958e1/users/d7d56025d3cc490baae1b8d8e0b68f29/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:17.586610 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.586898 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.587178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.614944 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] MFA Rules not processed for user `d7d56025d3cc490baae1b8d8e0b68f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:17.616805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:17.681711 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1378/2754] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:28:17.692479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:17.694613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:17.708302 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:17.754806 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bf36-da5c-4882-974b-d7a15968035b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:17.758751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:17.759365 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:17.759657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:17.759953 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:17.768330 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:17.769758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a28b5-66c6-4d24-b719-fa93a7af0a86 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:17.779307 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1377/2755] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:27.679226 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:27.775320 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=21 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:27.856523 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:27.918642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd6971-789e-461c-b8f5-9980f4e5efa4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:27.923358 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:27.924056 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:27.924344 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:27.924625 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] PATH_INFO: `/v3/users/d7d56025d3cc490baae1b8d8e0b68f29` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:27.925794 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d56025d3cc490baae1b8d8e0b68f29)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:27.927705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:27.974923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d56025d3cc490baae1b8d8e0b68f29'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:27.982845 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d56025d3cc490baae1b8d8e0b68f29'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:27.983478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d56025d3cc490baae1b8d8e0b68f29'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:27.990294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d56025d3cc490baae1b8d8e0b68f29'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.002613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d56025d3cc490baae1b8d8e0b68f29'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.008685 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1379/2756] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:28:27 2022] DELETE /identity/v3/users/d7d56025d3cc490baae1b8d8e0b68f29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:28.013204 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.013498 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.013778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.032670 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:28.033815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:28.093614 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1378/2757] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:28.104058 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.105510 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:28.163474 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569585e-3d9f-4841-a1a1-dc26e1ff3fb1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.167122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.167729 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.168044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.168322 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.177208 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.178728 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdbba7-9e97-4e0c-9c98-017906048466 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.188117 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1380/2758] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:28.450217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.451643 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:28.464371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc2af3-20bf-4290-bf6e-cfddc0f863ec None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.469214 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.469753 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.470036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.470613 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] PATH_INFO: `/v3/projects/b1d70347c79a4d7db195b2e9683958e1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.471857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d70347c79a4d7db195b2e9683958e1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.473803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.522950 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d70347c79a4d7db195b2e9683958e1', 'request_id': 'req-deb3eae0-dd34-466a-b897-3205426f9108'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.529016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d70347c79a4d7db195b2e9683958e1', 'request_id': 'req-deb3eae0-dd34-466a-b897-3205426f9108'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.534573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d70347c79a4d7db195b2e9683958e1', 'request_id': 'req-deb3eae0-dd34-466a-b897-3205426f9108'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.547331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] The token cache is being invalidate because project b1d70347c79a4d7db195b2e9683958e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:28:28.547620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.548266 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-deb3eae0-dd34-466a-b897-3205426f9108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:28:28.549800 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1379/2759] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:28:28 2022] DELETE /identity/v3/projects/b1d70347c79a4d7db195b2e9683958e1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:28.554969 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.555256 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.555533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.575277 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:28.576505 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:28.593992 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:28.637061 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1381/2760] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:28:28.644829 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.645119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.645397 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.666145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:28.667359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:28.675545 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1380/2761] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:28.680077 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.689637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ab4c-46a0-43ed-af26-cdd15390ca09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.694855 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.695450 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.695732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.696039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.696727 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:28:28.697027 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.698598 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.711137 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1382/2762] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:28:28.715298 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.724578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d8a04-75ac-4499-9468-c64640e989b7 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.729342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.729945 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.730220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.730497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.731162 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.733093 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.760481 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1381/2763] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:28:28.764701 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.776070 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e20749-a7f5-49e0-8d2d-1c8b13b0687c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.835097 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.835993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.836280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.836653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.837323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.839235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.859154 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1383/2764] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:28:28.864264 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.878255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd065f-6fa1-48f7-ac87-ae7725511726 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.883647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.884282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.884561 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.884857 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.885545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.887132 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.897026 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1382/2765] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:28.901220 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.912010 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102140d-f209-4bc3-8c7e-62074b8f12f6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.916776 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.917385 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.917672 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.917950 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.918649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.920273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad1a4-33f9-41f1-be70-8ed69675d150 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.931222 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1384/2766] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:28.935378 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:28.946373 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979facf5-98ec-453e-98f7-038007457231 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:28.951036 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:28.951691 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.952008 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.952292 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] PATH_INFO: `/v3/projects/a84d844deb5342dea75f5b8506f2c4ab/users/baaef28549a6484486f8e925ceebcd22/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:28.967387 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84d844deb5342dea75f5b8506f2c4ab, user_id=baaef28549a6484486f8e925ceebcd22, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:28.970071 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:28.983138 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1383/2767] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:28:28 2022] PUT /identity/v3/projects/a84d844deb5342dea75f5b8506f2c4ab/users/baaef28549a6484486f8e925ceebcd22/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:28.988179 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a01c8-cb2d-42b9-9573-f264e963153e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:28.988504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a01c8-cb2d-42b9-9573-f264e963153e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:28.988804 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a01c8-cb2d-42b9-9573-f264e963153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:29.009888 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-907a01c8-cb2d-42b9-9573-f264e963153e None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:29.011101 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-907a01c8-cb2d-42b9-9573-f264e963153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:29.070473 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1385/2768] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:29.080312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:29.082295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:29.105040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:29.141978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2043cb8-fa6f-4bb8-884b-77c52dffa5e9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:29.145698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:29.146309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:29.146588 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:29.146865 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:29.155803 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:29.157263 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:29.166717 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1384/2769] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:33.392543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.393124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.393124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.425082 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] MFA Rules not processed for user `baaef28549a6484486f8e925ceebcd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:33.426323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:33.446321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:33.499105 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1386/2770] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:28:33.503811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.515758 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc15e03-f054-4297-bfaf-354bc9c61793 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.528101 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.528864 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.529018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.529479 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.530159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.532770 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.562804 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1385/2771] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:28:33 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:28:33.567353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.582445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d28627-067c-40f2-a5d8-9aeb91a8d8a0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.643437 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.644103 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.644393 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.644669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.645350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.648053 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.670945 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1387/2772] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:28:33 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:28:33.675014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.686260 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afd49c-da45-491d-ac67-e69fd3213d97 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.690889 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.691515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.691799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.692110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.692810 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.694455 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.705966 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1386/2773] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:33.711372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.721863 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a0bd6-f22f-4226-a961-278ba302d49a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.727635 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.728354 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.728642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.728923 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] PATH_INFO: `/v3/projects/19df3815256c436dbaad8a146777d7aa/users/1d114ff50f4f4b42bc99e6004af5b989/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.745012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19df3815256c436dbaad8a146777d7aa, user_id=1d114ff50f4f4b42bc99e6004af5b989, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.747691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.762538 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1388/2774] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:28:33 2022] PUT /identity/v3/projects/19df3815256c436dbaad8a146777d7aa/users/1d114ff50f4f4b42bc99e6004af5b989/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:28:33.766538 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.777272 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58560b6a-e340-486d-bbeb-9a8253345e50 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.836870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.837506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.837814 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.838090 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.838787 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.840428 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078d3b4-d90e-4602-b84b-496ed8f79191 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.852891 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1387/2775] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:28:33.856691 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:33.868722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b99468-d7cc-4ef8-98af-d5cc11643130 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:33.875552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:33.876365 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:33.876648 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:33.876924 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] PATH_INFO: `/v3/projects/19df3815256c436dbaad8a146777d7aa/users/1d114ff50f4f4b42bc99e6004af5b989/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:33.878918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19df3815256c436dbaad8a146777d7aa, user_id=1d114ff50f4f4b42bc99e6004af5b989, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:33.881798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:33.893396 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1389/2776] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:28:33 2022] PUT /identity/v3/projects/19df3815256c436dbaad8a146777d7aa/users/1d114ff50f4f4b42bc99e6004af5b989/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:28:38.356463 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7210f-b33b-4fa0-9856-3e0a136d40bd None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:38.356996 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7210f-b33b-4fa0-9856-3e0a136d40bd None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:38.357110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7210f-b33b-4fa0-9856-3e0a136d40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:38.385495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-1cb7210f-b33b-4fa0-9856-3e0a136d40bd None None] MFA Rules not processed for user `1d114ff50f4f4b42bc99e6004af5b989`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:38.386718 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1cb7210f-b33b-4fa0-9856-3e0a136d40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:38.465362 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1388/2777] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:38.482558 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:38.485171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:38.573352 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb9b16-9279-44ef-8370-70de689b4342 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:38.578805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:38.579423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:38.579707 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:38.580045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:38.586663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:38.639341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:38.640951 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:38.651151 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1390/2778] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:39.769099 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:39.769629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:39.769746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:39.789534 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] MFA Rules not processed for user `baaef28549a6484486f8e925ceebcd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:28:39.791019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:39.799254 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1389/2779] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:28:48.646304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=24 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:49.783689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:28:58.195171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:58.196920 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:58.254111 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d009b-ea13-4318-8e00-127af14d669a service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:58.257806 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:58.258430 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:58.258706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:58.258985 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:58.260757 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:58.274214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:58.275749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:58.286718 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1391/2780] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:58.571440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:58.625632 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b681c1-1b0e-493b-aca8-4f47cf7554c6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:58.629285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:58.629831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:58.630113 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:58.630402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:58.632168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:58.641958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:58.643371 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:58.651989 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1390/2781] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:28:59.103337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:59.104782 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:59.113220 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:28:59.114619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:59.125451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4cfd0-4355-49f9-ab2e-2aa1880b6bf3 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:59.132123 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:59.132755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:59.133098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:59.133409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:59.135312 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:59.149651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:59.151003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:59.162781 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1391/2782] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:28:59.178423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10122d1-42f4-4576-9df0-352b0afbdb3e service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:28:59.183721 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:28:59.184539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:28:59.184823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:28:59.185100 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:28:59.186866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:28:59.200608 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:28:59.202211 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:28:59.213756 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1392/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:28:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:01.013970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:01.023497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab947b-ceec-41ef-a868-dc2038b54704 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:01.028277 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:01.028900 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:01.029183 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:01.029464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:01.031284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:01.042513 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:01.044143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:01.053637 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1392/2784] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:01.638918 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:01.640602 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:01.663243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702eba-0a09-4a21-b47d-094e13ad83b8 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:01.674329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:01.674996 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:01.675280 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:01.675556 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:01.677557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:01.690705 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:01.692317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:01.703849 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1393/2785] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:08.235653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:08.249404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76d03-e41c-4bf3-8601-bf33172c17bd service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:08.254871 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:08.255477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:08.255755 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:08.256058 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:08.257782 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:08.270571 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:08.272353 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac39fa-ae6b-4b7e-8168-8259ee610d76 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:08.284577 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1393/2786] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:11.056370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:11.065916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b390a1-69ed-40de-af7d-6a75c73607e1 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:11.069513 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:11.070115 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:11.070399 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:11.070892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:11.079802 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:11.081525 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:11.091531 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1394/2787] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:29:18.280040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=44 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:21.086841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=70 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:42.493338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:42.493861 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:42.493978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:42.514818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] MFA Rules not processed for user `804d6e5eba9e42a7bf39d9c84565632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:29:42.516097 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:42.570788 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1394/2788] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:29:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:29:52.564226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=25 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:29:53.621294 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:29:53.637685 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef08e-c329-4347-a471-6b6fcb13e60f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:29:53.644174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:29:53.644787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:29:53.645062 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:29:53.645337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:29:53.647114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:29:53.660276 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:29:53.661847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24053e88-de3f-4ec8-8505-c34d1ea1bf09 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:29:53.672499 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1395/2789] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:29:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:30:03.668107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:10.789251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:10.799230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffe2d9-9ce3-4581-bf1f-1f372ea074c6 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:10.802880 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:10.803515 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:10.803802 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:10.804107 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:10.806405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:10.817149 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:10.818557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:10.827977 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1395/2790] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:20.823925 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:20.851896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:20.852421 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:20.852537 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:20.872692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] MFA Rules not processed for user `804d6e5eba9e42a7bf39d9c84565632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:31:20.873892 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:20.880780 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1396/2791] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:31:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:31:30.866879 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:31:52.086843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:52.098319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855c30f-8a62-4153-9138-e95589dba8e1 service cinder] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:52.103194 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:52.103796 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:52.104116 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:52.104389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:52.106137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:52.117516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:52.119625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:52.129540 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1396/2792] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:52.740795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:52.751531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032180f-9ce4-4048-bd11-f59afa22ebbf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:52.756265 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:52.757122 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:52.757406 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:52.757682 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:52.759695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:52.770873 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:52.772536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:52.782413 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1397/2793] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:31:53.885611 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:31:53.895569 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9e759-1a78-49e7-b19b-44179a1a83cb service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:31:53.899226 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:31:53.900137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:31:53.900545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:31:53.900825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:31:53.902686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:31:53.916730 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:31:53.918164 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:31:53.929097 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1397/2794] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:32:02.778686 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:32:03.924339 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=12 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:02.883317 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:02.892980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdfaff-d703-4199-a899-067d2a0b4bf1 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:02.896656 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:02.897269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:02.897554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:02.897831 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:02.899607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:02.962554 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:02.964004 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:02.973719 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1398/2795] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:06.031964 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.033638 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:06.051306 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a96ff2-1a24-4014-b9e2-702b9bdcf55e service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.058118 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.058756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.059040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.059317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.063689 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:06.077506 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.079972 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.102400 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.103119 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1398/2796] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:06.105466 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:06.119135 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08af052-b086-4e2a-b919-fe539272969b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.125044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.125967 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.126425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.126711 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] PATH_INFO: `/v3/users/804d6e5eba9e42a7bf39d9c84565632b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.127973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804d6e5eba9e42a7bf39d9c84565632b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.129932 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.181120 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804d6e5eba9e42a7bf39d9c84565632b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.188475 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804d6e5eba9e42a7bf39d9c84565632b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.189295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804d6e5eba9e42a7bf39d9c84565632b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.196374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804d6e5eba9e42a7bf39d9c84565632b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.209026 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-824731d9-9930-4836-98bc-7951ff7ab8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804d6e5eba9e42a7bf39d9c84565632b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.215075 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1399/2797] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:06 2022] DELETE /identity/v3/users/804d6e5eba9e42a7bf39d9c84565632b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:06.396171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.408389 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a837d1-623b-4e0f-b508-f96c887ac8c9 service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.468533 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.469168 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.469449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.469724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] PATH_INFO: `/v3/projects/8b791b67d5584c5fbbaf50fea34d8276` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.470868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b791b67d5584c5fbbaf50fea34d8276)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.472812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.517665 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b791b67d5584c5fbbaf50fea34d8276', 'request_id': 'req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.523890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b791b67d5584c5fbbaf50fea34d8276', 'request_id': 'req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.530254 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b791b67d5584c5fbbaf50fea34d8276', 'request_id': 'req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.542620 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] The token cache is being invalidate because project 8b791b67d5584c5fbbaf50fea34d8276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:06.542909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.543525 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-39e3a1ba-5869-4a4a-a7e4-c7ce9669577d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:06.545175 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1399/2798] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:06 2022] DELETE /identity/v3/projects/8b791b67d5584c5fbbaf50fea34d8276 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:06.550156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.550435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.550710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.571012 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:06.572261 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:06.632193 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1400/2799] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:33:06.640619 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.640903 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.641176 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.660647 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:06.661848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:06.670070 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1400/2800] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:06.674272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.684102 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66367133-3078-4227-9f33-4ff7afbc4ed5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.689530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.690148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.690433 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.690709 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.691405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:33:06.691715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.693342 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.694908 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:06.708167 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1401/2801] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:33:06.712181 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.721805 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f65f77-ed70-4b8d-9492-f16c1ea260ed None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.726442 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.727040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.727321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.727591 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.728273 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.730186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.759685 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1401/2802] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:06 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:06.764606 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.774820 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86d06e-6923-4045-a0e2-47dcee92a540 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.830286 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.830824 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.831107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.831383 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.832081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.834233 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.855189 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1402/2803] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:06 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:33:06.859393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.869811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84e0-f827-46cf-a4ee-4112f4ce74d9 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.874922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.875526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.875811 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.876131 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.876853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.878488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.889269 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1402/2804] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:06.893030 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.902894 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183866a-3228-4fe3-a283-cae8c3e5da45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.907696 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.908328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.908609 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.908886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.909565 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.911144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b56f8-e231-40b6-a6ab-fe8d252b5ec2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.922190 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1403/2805] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:06.926190 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:06.936815 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750286-01a3-4e4a-9657-4bac5ccbcd26 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:06.941510 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:06.942142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.942421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.942696 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] PATH_INFO: `/v3/projects/a09c503159dc4bdca3b52f22b0b92e40/users/44899bd0043247d5a94d65a41e24a5ff/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:06.957201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09c503159dc4bdca3b52f22b0b92e40, user_id=44899bd0043247d5a94d65a41e24a5ff, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:06.960138 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:06.976386 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1403/2806] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:06 2022] PUT /identity/v3/projects/a09c503159dc4bdca3b52f22b0b92e40/users/44899bd0043247d5a94d65a41e24a5ff/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:06.988191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:06.988488 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:06.988774 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:07.016786 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] MFA Rules not processed for user `44899bd0043247d5a94d65a41e24a5ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:07.018013 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:07.082396 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1404/2807] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:07.093296 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:07.095110 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:07.109851 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:07.152757 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff452-77fd-4e89-bd5a-a2335e9aac3f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:07.156459 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:07.157067 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:07.157347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:07.157616 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:07.166698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:07.168143 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f80fe-e658-4eee-99c7-b0f0d74422cc service cinder] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:07.177593 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1404/2808] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:15.568169 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:15.630636 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b192c7-3555-4d31-afe4-e56827153a6f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:15.635146 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:15.635780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:15.636107 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:15.636377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] PATH_INFO: `/v3/users/44899bd0043247d5a94d65a41e24a5ff` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:15.637538 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44899bd0043247d5a94d65a41e24a5ff)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:15.639445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:15.642236 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:15.686646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44899bd0043247d5a94d65a41e24a5ff'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:15.693856 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44899bd0043247d5a94d65a41e24a5ff'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:15.694487 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44899bd0043247d5a94d65a41e24a5ff'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:15.701288 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44899bd0043247d5a94d65a41e24a5ff'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:15.713866 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44899bd0043247d5a94d65a41e24a5ff'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:15.720207 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1405/2809] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:15 2022] DELETE /identity/v3/users/44899bd0043247d5a94d65a41e24a5ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:15.724776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:15.725267 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:15.725392 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:15.744676 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:15.745876 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:15.804255 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1405/2810] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:15.814160 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:15.815586 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:15.872396 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57833b-1c5e-4784-8d5e-8f77c309314c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:15.876281 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:15.876889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:15.877171 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:15.877445 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:15.886861 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:15.888333 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b271f-56c4-46d8-9506-691214bbb823 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:15.898555 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1406/2811] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:16.164946 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.166728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:16.180230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0b882-0e53-49ec-8244-298d72ab57f4 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.184844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.185482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.185762 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.186039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] PATH_INFO: `/v3/projects/a09c503159dc4bdca3b52f22b0b92e40` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.187822 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09c503159dc4bdca3b52f22b0b92e40)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.189830 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.238728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09c503159dc4bdca3b52f22b0b92e40', 'request_id': 'req-5cc8c693-8de5-4543-805a-b807bb18a0ab'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:16.245249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09c503159dc4bdca3b52f22b0b92e40', 'request_id': 'req-5cc8c693-8de5-4543-805a-b807bb18a0ab'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:16.252021 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09c503159dc4bdca3b52f22b0b92e40', 'request_id': 'req-5cc8c693-8de5-4543-805a-b807bb18a0ab'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:16.264004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] The token cache is being invalidate because project a09c503159dc4bdca3b52f22b0b92e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:16.264297 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:16.265587 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-5cc8c693-8de5-4543-805a-b807bb18a0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:16.267155 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1406/2812] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:16 2022] DELETE /identity/v3/projects/a09c503159dc4bdca3b52f22b0b92e40 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:16.273312 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.273604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.273884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.293295 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:16.294539 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:16.354265 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1407/2813] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:16.362776 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.363061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.363457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.383557 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:16.384789 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:16.393255 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1407/2814] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:16.397549 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.407452 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40ff2-6b31-4fe7-95b1-ca4dfc46017c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.412075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.412681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.412966 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.413244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.413941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:33:16.414244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.415865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.427672 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1408/2815] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:33:16.432019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.444147 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9fe47-3105-4c1a-b818-54e781ec2e3d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.446678 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.447283 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.447615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.447890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.448585 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.450464 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.479420 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1408/2816] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:16.483734 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.493746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfdcf-4c6a-493f-8205-042505641eec admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.502173 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:16.552540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.553158 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.553444 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.553739 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.554390 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.556332 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.579418 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1409/2817] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:16.584020 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.595105 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1dfe-423e-4160-8914-ce274ae0b10f admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.599764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.600403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.600686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.600967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.601654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.603234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.608502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:16.615032 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1409/2818] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:33:16.618980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.629808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b9ed-ad98-4d2c-ba2a-77ccb2f47a98 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.634552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.635156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.635442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.635722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.636461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.638041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d09a-b0b1-4ae7-88d8-e40e0ae0bd16 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.648714 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1410/2819] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:16.652664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.662724 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aef1d-67d2-410c-835c-e12a8ecbf72b admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.667694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.668412 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.668695 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.669004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] PATH_INFO: `/v3/projects/e9a831dd8fa54c55b0f6afefb3a4dbed/users/3bd4de8f4ba544be9f3a6675f24c0c55/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.686415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a831dd8fa54c55b0f6afefb3a4dbed, user_id=3bd4de8f4ba544be9f3a6675f24c0c55, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.689780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.702409 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1410/2820] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:16 2022] PUT /identity/v3/projects/e9a831dd8fa54c55b0f6afefb3a4dbed/users/3bd4de8f4ba544be9f3a6675f24c0c55/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:16.712928 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.713214 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.713489 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.741442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] MFA Rules not processed for user `3bd4de8f4ba544be9f3a6675f24c0c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:16.742681 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:16.806595 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1411/2821] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:16.811014 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.871348 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993c9b-80ab-475e-88eb-2de900a1bd6c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.876578 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.877185 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.877468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.877741 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.878400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.880319 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:16.912638 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1411/2822] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:16.916732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:16.927995 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f02b5a-52c3-41a6-8316-de0a6689d2b1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:16.983299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:16.984803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:16.985067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:16.985339 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:16.986003 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:16.987910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.007875 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1412/2823] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:16 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:17.012040 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.022402 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e437-4f91-4bf8-8c46-ccb257d45e0c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.027115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.027723 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.028043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.028351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.029073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.031282 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.041811 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1412/2824] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:17.045792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.056316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b2c57-9321-44ab-88ef-c86264ac1ccf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.060889 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.061569 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.061976 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.062255 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] PATH_INFO: `/v3/projects/db8d982c60ce4692af60e3d3274d3096/users/971a986ca62f4a69937c1ccfb79b3e58/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.065819 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:17.079259 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8d982c60ce4692af60e3d3274d3096, user_id=971a986ca62f4a69937c1ccfb79b3e58, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.081952 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.095665 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1413/2825] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:17 2022] PUT /identity/v3/projects/db8d982c60ce4692af60e3d3274d3096/users/971a986ca62f4a69937c1ccfb79b3e58/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:33:17.099579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.110545 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f66c0-f16e-495c-9e78-74c51874215d admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.166080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.166599 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.166887 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.167167 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.167858 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.169483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb73fe-7cf5-47db-b5c6-d977fb3de093 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.179732 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1413/2826] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:17.183817 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.194170 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eba793-9c00-40e5-aa9f-7512aeb9e87f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.198702 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.199351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.199631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.199905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] PATH_INFO: `/v3/projects/db8d982c60ce4692af60e3d3274d3096/users/971a986ca62f4a69937c1ccfb79b3e58/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.201901 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8d982c60ce4692af60e3d3274d3096, user_id=971a986ca62f4a69937c1ccfb79b3e58, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.204576 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.215259 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1414/2827] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:17 2022] PUT /identity/v3/projects/db8d982c60ce4692af60e3d3274d3096/users/971a986ca62f4a69937c1ccfb79b3e58/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:17.227275 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.227683 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.228005 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.259235 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] MFA Rules not processed for user `971a986ca62f4a69937c1ccfb79b3e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:17.260558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:17.293711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:17.330442 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1414/2828] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:17.341442 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.343738 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:17.400630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcedec-b041-4ad5-8210-7b82257690c0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.404329 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.404931 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.405213 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.406050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.415050 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.416552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81169087-a177-47f4-8be6-c9da0b49280b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.426126 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1415/2829] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:17.792331 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:17.855426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439731b-fd66-4ff2-b5ba-32cd8af42473 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:17.860593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:17.861284 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.861566 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.861844 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] PATH_INFO: `/v3/users/3bd4de8f4ba544be9f3a6675f24c0c55` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.863003 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd4de8f4ba544be9f3a6675f24c0c55)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:17.864980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:17.910801 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd4de8f4ba544be9f3a6675f24c0c55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:17.917684 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd4de8f4ba544be9f3a6675f24c0c55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:17.918285 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd4de8f4ba544be9f3a6675f24c0c55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:17.918943 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd4de8f4ba544be9f3a6675f24c0c55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:17.930698 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd4de8f4ba544be9f3a6675f24c0c55'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:17.944137 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1415/2830] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:17 2022] DELETE /identity/v3/users/3bd4de8f4ba544be9f3a6675f24c0c55 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:17.948911 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:17.949401 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:17.949512 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:17.969482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:17.970699 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:18.028740 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1416/2831] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:18.038575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:18.040066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:18.098250 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652b03e-c833-4f6f-84ef-ab0f118313a3 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:18.101952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:18.102563 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:18.102852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:18.103130 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:18.109744 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:18.114161 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:18.116572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:18.127371 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1416/2832] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:33:18.387297 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:18.388760 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:18.401456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd998bb-041d-4423-be7c-1c148f75d8b5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:18.406249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:18.406903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:18.407185 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:18.407464 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] PATH_INFO: `/v3/projects/e9a831dd8fa54c55b0f6afefb3a4dbed` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:18.409209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a831dd8fa54c55b0f6afefb3a4dbed)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:18.411269 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:18.461731 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a831dd8fa54c55b0f6afefb3a4dbed', 'request_id': 'req-8dede218-5f67-42d9-9892-a21fcbd2844f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.467405 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a831dd8fa54c55b0f6afefb3a4dbed', 'request_id': 'req-8dede218-5f67-42d9-9892-a21fcbd2844f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.475350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a831dd8fa54c55b0f6afefb3a4dbed', 'request_id': 'req-8dede218-5f67-42d9-9892-a21fcbd2844f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.482436 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:18.488552 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] The token cache is being invalidate because project e9a831dd8fa54c55b0f6afefb3a4dbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:18.489019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.490045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.491879 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1417/2833] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:18 2022] DELETE /identity/v3/projects/e9a831dd8fa54c55b0f6afefb3a4dbed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:18.496075 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:18.505873 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09730bf-7af8-4e39-9f41-eb6440b0aefe service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:18.568935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:18.569581 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:18.569867 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:18.570145 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] PATH_INFO: `/v3/users/971a986ca62f4a69937c1ccfb79b3e58` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:18.571315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971a986ca62f4a69937c1ccfb79b3e58)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:18.573274 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:18.619499 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971a986ca62f4a69937c1ccfb79b3e58'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.626354 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971a986ca62f4a69937c1ccfb79b3e58'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.627035 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971a986ca62f4a69937c1ccfb79b3e58'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.627651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971a986ca62f4a69937c1ccfb79b3e58'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.639469 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-531e5fc0-dc8d-4dfb-ae2c-80ea299f26f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971a986ca62f4a69937c1ccfb79b3e58'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:18.652057 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1417/2834] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:18 2022] DELETE /identity/v3/users/971a986ca62f4a69937c1ccfb79b3e58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:18.920660 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:18.923544 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:18.937631 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede218-5f67-42d9-9892-a21fcbd2844f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:18.998661 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:18.999852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.000119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.000372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] PATH_INFO: `/v3/projects/db8d982c60ce4692af60e3d3274d3096` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.001540 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8d982c60ce4692af60e3d3274d3096)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.003434 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.048424 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8d982c60ce4692af60e3d3274d3096', 'request_id': 'req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:19.053741 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8d982c60ce4692af60e3d3274d3096', 'request_id': 'req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:19.061151 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8d982c60ce4692af60e3d3274d3096', 'request_id': 'req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:19.073022 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] The token cache is being invalidate because project db8d982c60ce4692af60e3d3274d3096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:19.073314 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:19.073980 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-8947d18b-01b1-4cb8-bad3-f6a6f82eeae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:19.075481 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1418/2835] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:18 2022] DELETE /identity/v3/projects/db8d982c60ce4692af60e3d3274d3096 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:19.080426 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.080886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.081026 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.101831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:19.103051 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:19.160695 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1418/2836] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:33:19.168340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.168626 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.168903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.189148 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:19.190335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:19.198148 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1419/2837] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:19.202217 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.212336 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c5658-8f3e-4607-8e59-3f957f593217 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.217039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.217650 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.218544 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.218831 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.219555 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:33:19.219860 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.221484 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.230115 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:19.234434 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1419/2838] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:33:19.238325 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.248543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7f56-851c-498d-9644-43ca8ce699a6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.253377 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.253919 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.254195 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.254467 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.255117 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.257034 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.284109 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1420/2839] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:19.288256 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.298883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611c873-b2ce-433f-bd17-2e9b2ae40c00 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.354257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.354870 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.355155 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.355429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.356127 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.358037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.378508 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1420/2840] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:19.382653 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.393374 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296bb1-69aa-405c-98a3-863009da4205 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.398095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.398700 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.398982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.399252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.399954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.401543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.412406 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1421/2841] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:19.416236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.426818 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b85b37-0b62-4e11-8116-b2c5d1a56f34 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.431559 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.432215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.432593 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.432869 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.433558 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.435179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9858a66-92f6-41c6-a3d1-2df322d1f6f1 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.446664 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1421/2842] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:19.450334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.461028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2697b-a28d-48e5-901c-55306b44eaa5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.465974 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.466710 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.466994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.467273 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] PATH_INFO: `/v3/projects/480cfcf068e14e9692a2bdd2ee923ba7/users/b53b943d9cd64aceb5fb8db546d25cb7/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.482299 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480cfcf068e14e9692a2bdd2ee923ba7, user_id=b53b943d9cd64aceb5fb8db546d25cb7, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.485827 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.497881 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1422/2843] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:19 2022] PUT /identity/v3/projects/480cfcf068e14e9692a2bdd2ee923ba7/users/b53b943d9cd64aceb5fb8db546d25cb7/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:33:19.508262 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.508497 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.508778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.536281 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] MFA Rules not processed for user `b53b943d9cd64aceb5fb8db546d25cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:19.537504 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:19.602316 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1422/2844] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:19.613994 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:19.615805 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:19.642692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:19.695373 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eadc18-ff32-4f64-bb8c-e8dd8e408a73 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:19.699114 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:19.699732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:19.700044 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:19.700323 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:19.709531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:19.710953 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791907a3-9d2a-4ce9-ae1a-fef63afc9369 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:19.721259 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1423/2845] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:29.599393 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:29.715743 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=24 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:38.370541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:38.432207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339a0b4-2285-40c9-903c-cd20976bb628 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:38.436750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:38.437954 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:38.438355 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:38.438651 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] PATH_INFO: `/v3/users/b53b943d9cd64aceb5fb8db546d25cb7` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:38.439809 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53b943d9cd64aceb5fb8db546d25cb7)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:38.441746 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:38.487615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53b943d9cd64aceb5fb8db546d25cb7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:38.494615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53b943d9cd64aceb5fb8db546d25cb7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:38.495289 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53b943d9cd64aceb5fb8db546d25cb7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:38.495908 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53b943d9cd64aceb5fb8db546d25cb7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:38.508343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53b943d9cd64aceb5fb8db546d25cb7'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:38.522207 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1423/2846] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:38 2022] DELETE /identity/v3/users/b53b943d9cd64aceb5fb8db546d25cb7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:38.526732 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:38.527250 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:38.527360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:38.546156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:38.547530 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:38.606421 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1424/2847] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:33:38.615901 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:38.617334 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:38.681828 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ec39-39f6-4c39-888c-e331b1a18c75 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:38.685602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:38.686218 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:38.686503 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:38.686781 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:38.696485 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:38.697917 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9c2db-bd68-46ff-b5dc-50cc18d568d5 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:38.708350 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1424/2848] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:39.030478 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.032543 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:39.045568 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10ee13-dd97-4da6-b707-3ad898b543c5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.050534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.051174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.051454 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.051726 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] PATH_INFO: `/v3/projects/480cfcf068e14e9692a2bdd2ee923ba7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.054015 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480cfcf068e14e9692a2bdd2ee923ba7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.056025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.103942 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480cfcf068e14e9692a2bdd2ee923ba7', 'request_id': 'req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:39.109490 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480cfcf068e14e9692a2bdd2ee923ba7', 'request_id': 'req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:39.117061 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480cfcf068e14e9692a2bdd2ee923ba7', 'request_id': 'req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:39.128652 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] The token cache is being invalidate because project 480cfcf068e14e9692a2bdd2ee923ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:39.128947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:39.129583 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f75f741d-c1b1-44ee-ab45-93dccbe6c9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:39.131148 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1425/2849] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:39 2022] DELETE /identity/v3/projects/480cfcf068e14e9692a2bdd2ee923ba7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:39.136029 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.136343 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.136622 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.156687 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:39.157825 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:39.174655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:39.220081 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1425/2850] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:39.226854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.227152 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.227435 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.247772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:39.249156 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:39.257860 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1426/2851] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:39.262073 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.272792 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a5faa-5e0c-430b-99f4-05f7ac6e116f None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.277457 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.278065 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.278352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.278629 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.279317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:33:39.279625 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.281341 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.293199 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1426/2852] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:33:39.297389 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.306615 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e66694-3602-406a-9c34-03a5980ba9a8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.311227 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.311823 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.312134 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.312949 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.313604 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.315468 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.342537 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1427/2853] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:39 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:39.346847 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.356852 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13688-976c-44b7-9040-feb6feb4db3a admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.414600 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.415255 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.415425 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.415694 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.416420 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.418372 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.442151 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1427/2854] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:39 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:39.446808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.457237 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e3416-b85c-4f1b-99df-755374848a3b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.462193 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.462795 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.463074 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.463348 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.464076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.465684 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.475795 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1428/2855] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:39.479774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.490921 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322396a-5091-49c2-8d67-8816bfc24516 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.495603 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.496249 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.496539 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.496820 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.497547 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.499148 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052a1f-4b32-49b3-9e0e-1c1f801c03b8 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.511376 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1428/2856] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:39.515580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.525878 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c394e-0ec7-420d-a36d-b4d28569307c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.530680 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.531533 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.531973 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.532264 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] PATH_INFO: `/v3/projects/25bf00260cde4bf58d749a7e5acfd013/users/859a6a77c6ac46c196223c44906a9fbf/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.547127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bf00260cde4bf58d749a7e5acfd013, user_id=859a6a77c6ac46c196223c44906a9fbf, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.550268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.563924 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1429/2857] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:39 2022] PUT /identity/v3/projects/25bf00260cde4bf58d749a7e5acfd013/users/859a6a77c6ac46c196223c44906a9fbf/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 31 01:33:39.573842 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.574137 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.574451 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.602985 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] MFA Rules not processed for user `859a6a77c6ac46c196223c44906a9fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:39.604257 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:39.666742 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1429/2858] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:39.678675 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:39.680440 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:39.703955 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:39.741695 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec29e-66c0-4622-aba1-cc55f213768a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:39.745350 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1d0d00aea849cb97808332cb98cfbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:39.745993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:39.746274 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:39.746550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:39.755673 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:39.757137 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:39.766039 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1430/2859] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:49.663812 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:49.761869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=17 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:51.631223 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:51.632654 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:51.688318 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a07de-7bf1-461c-9131-8c38d95de6f2 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:51.692236 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:51.692843 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:51.693121 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:51.693391 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:51.695166 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:51.752883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:51.754295 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18012-cfd5-4a48-aaae-e3c47c7e9c45 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:51.763364 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1430/2860] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:52.191807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:52.266927 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f5f56-8b53-4b2d-9f9b-ce586ecf215e service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:52.271620 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:52.272304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:52.272589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:52.272868 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] PATH_INFO: `/v3/users/859a6a77c6ac46c196223c44906a9fbf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:52.274054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859a6a77c6ac46c196223c44906a9fbf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:52.275998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:52.323998 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859a6a77c6ac46c196223c44906a9fbf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.331925 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859a6a77c6ac46c196223c44906a9fbf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.332561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859a6a77c6ac46c196223c44906a9fbf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.339865 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859a6a77c6ac46c196223c44906a9fbf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.352708 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859a6a77c6ac46c196223c44906a9fbf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.358705 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1431/2861] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:33:52 2022] DELETE /identity/v3/users/859a6a77c6ac46c196223c44906a9fbf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:52.363868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:52.364201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:52.364486 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:52.384690 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:52.385915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:52.451561 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1431/2862] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:33:52.461713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:52.463353 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:52.523067 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f59e9f-b5cd-49ac-b797-b2a694aaa1a4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:52.527126 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:52.527746 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:52.528076 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:52.528355 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:52.537881 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:52.539310 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c291f-4b72-408f-abfc-e05ff0d03e77 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:52.549830 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1432/2863] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:52.872238 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:52.873872 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:52.897489 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968964b8-e252-4952-9c0a-7e44c676c941 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:52.916177 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:52.916839 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:52.917579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:52.917579 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] PATH_INFO: `/v3/projects/25bf00260cde4bf58d749a7e5acfd013` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:52.919019 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bf00260cde4bf58d749a7e5acfd013)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:52.921418 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:52.978669 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bf00260cde4bf58d749a7e5acfd013', 'request_id': 'req-f82c9613-c38e-410a-b8a8-8c9bddf77777'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.979923 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:52.986488 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bf00260cde4bf58d749a7e5acfd013', 'request_id': 'req-f82c9613-c38e-410a-b8a8-8c9bddf77777'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:52.994470 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bf00260cde4bf58d749a7e5acfd013', 'request_id': 'req-f82c9613-c38e-410a-b8a8-8c9bddf77777'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:53.007186 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] The token cache is being invalidate because project 25bf00260cde4bf58d749a7e5acfd013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:33:53.007477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:53.008135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-f82c9613-c38e-410a-b8a8-8c9bddf77777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:33:53.009697 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1432/2864] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:33:52 2022] DELETE /identity/v3/projects/25bf00260cde4bf58d749a7e5acfd013 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:53.014587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.014875 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.015714 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.037095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:53.038392 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:53.055891 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:53.101951 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1433/2865] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:33:53.111049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.111449 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.111737 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.131361 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:53.132614 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:53.141271 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1433/2866] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:53.145472 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.155321 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79149b48-a6ce-45fb-b1a6-9813ffc0329c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.160642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.161252 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.161531 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.161803 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.162515 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:33:53.162799 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.164413 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.177089 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1434/2867] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:33:53.181612 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.191761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbca4e-704f-42ba-a19d-2d16615ca60d None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.196518 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.197134 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.197421 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.197697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.198490 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.200429 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.232753 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1434/2868] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:33:53 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:33:53.235412 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.248429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0eac4e-64d2-4790-90a7-8ca0b0919a74 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.306032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.306630 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.306910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.307188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.307847 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.309780 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.334004 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1435/2869] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:33:53 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:33:53.335311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.346458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e70797-c233-420a-bb77-1b798fcfc241 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.351403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.352061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.352351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.352634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.353438 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.355878 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.367810 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1435/2870] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:53.371859 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.382508 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d7632-64a5-4f80-8f0d-e40aa077b297 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.387420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.388078 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.388364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.388663 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.389362 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.391423 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b0613-9966-404d-8fd0-f9c6544931c6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.403011 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1436/2871] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:33:53.408276 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.418799 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0055c-10ea-4795-a7f7-89bb1fe3293e admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.424988 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.426159 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.426444 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.426721 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] PATH_INFO: `/v3/projects/91f2c307af954c2ea2feb3bc12cf4e16/users/ada90fd067824007928b5ef9d9cc576e/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.443215 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f2c307af954c2ea2feb3bc12cf4e16, user_id=ada90fd067824007928b5ef9d9cc576e, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.446056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.460262 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1436/2872] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:33:53 2022] PUT /identity/v3/projects/91f2c307af954c2ea2feb3bc12cf4e16/users/ada90fd067824007928b5ef9d9cc576e/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:33:53.471272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.471561 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.471844 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.504019 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] MFA Rules not processed for user `ada90fd067824007928b5ef9d9cc576e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:33:53.505300 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:53.578725 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1437/2873] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:33:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:33:53.590512 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:53.592315 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:53.652136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1037-523d-4ef1-98bb-7ff4e38f9135 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:53.656342 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cab-f642-41df-ad59-773521763b04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:53.657079 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cab-f642-41df-ad59-773521763b04 service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:53.657433 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cab-f642-41df-ad59-773521763b04 service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:53.657915 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550cab-f642-41df-ad59-773521763b04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:53.667395 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550cab-f642-41df-ad59-773521763b04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:53.668896 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550cab-f642-41df-ad59-773521763b04 service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:53.678354 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1437/2874] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:33:56.553178 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:33:56.554641 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:56.578388 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:33:56.616327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c1a52-cc52-4997-8386-98878d5e8380 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:33:56.620257 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:33:56.620899 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:33:56.621218 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:33:56.621495 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:33:56.623351 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:33:56.687327 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:33:56.689588 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:33:56.699319 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1438/2875] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:03.282230 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cab-f642-41df-ad59-773521763b04 service glance] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:03.286047 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-db550cab-f642-41df-ad59-773521763b04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:03.300364 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550cab-f642-41df-ad59-773521763b04 service glance] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:03.306084 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:03.306824 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:03.306995 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:03.307270 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] PATH_INFO: `/v3/users/baaef28549a6484486f8e925ceebcd22` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:03.308502 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaef28549a6484486f8e925ceebcd22)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:03.310434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:03.368180 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaef28549a6484486f8e925ceebcd22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.378087 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaef28549a6484486f8e925ceebcd22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.378743 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaef28549a6484486f8e925ceebcd22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.379352 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaef28549a6484486f8e925ceebcd22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.391655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:03.393080 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaef28549a6484486f8e925ceebcd22'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.412666 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1438/2876] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:34:03 2022] DELETE /identity/v3/users/baaef28549a6484486f8e925ceebcd22 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:03.590157 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:03.600607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51063b18-0471-43e8-89be-4fac378fcd0b service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:03.670903 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:03.671551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:03.672438 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:03.672957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] PATH_INFO: `/v3/projects/a84d844deb5342dea75f5b8506f2c4ab` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:03.674272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84d844deb5342dea75f5b8506f2c4ab)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:03.676275 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:03.723119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84d844deb5342dea75f5b8506f2c4ab', 'request_id': 'req-36e93ddf-b730-461e-b612-0c9dab34cca9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.728584 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84d844deb5342dea75f5b8506f2c4ab', 'request_id': 'req-36e93ddf-b730-461e-b612-0c9dab34cca9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.736041 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84d844deb5342dea75f5b8506f2c4ab', 'request_id': 'req-36e93ddf-b730-461e-b612-0c9dab34cca9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.743085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:03.748963 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] The token cache is being invalidate because project a84d844deb5342dea75f5b8506f2c4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:34:03.749292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.751306 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.752897 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1439/2877] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:34:03 2022] DELETE /identity/v3/projects/a84d844deb5342dea75f5b8506f2c4ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:03.757037 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:03.758404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:03.771664 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181bbcc-f3d4-42bc-8ede-51f968694579 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:03.828305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:03.828928 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:03.829211 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:03.829492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] PATH_INFO: `/v3/users/1d114ff50f4f4b42bc99e6004af5b989` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:03.830680 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d114ff50f4f4b42bc99e6004af5b989)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:03.832653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:03.878940 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d114ff50f4f4b42bc99e6004af5b989'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.885735 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d114ff50f4f4b42bc99e6004af5b989'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.886396 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d114ff50f4f4b42bc99e6004af5b989'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.887201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d114ff50f4f4b42bc99e6004af5b989'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.899041 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d114ff50f4f4b42bc99e6004af5b989'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:03.912582 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1439/2878] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:34:03 2022] DELETE /identity/v3/users/1d114ff50f4f4b42bc99e6004af5b989 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:04.093129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:04.094977 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:04.109713 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93ddf-b730-461e-b612-0c9dab34cca9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:04.167993 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:04.168632 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:04.168914 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:04.169191 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] PATH_INFO: `/v3/projects/19df3815256c436dbaad8a146777d7aa` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:04.170338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=19df3815256c436dbaad8a146777d7aa)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:04.172476 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:04.219910 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19df3815256c436dbaad8a146777d7aa', 'request_id': 'req-60320080-5c7d-4e0d-9abc-e59811baa4db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:04.225328 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19df3815256c436dbaad8a146777d7aa', 'request_id': 'req-60320080-5c7d-4e0d-9abc-e59811baa4db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:04.231649 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19df3815256c436dbaad8a146777d7aa', 'request_id': 'req-60320080-5c7d-4e0d-9abc-e59811baa4db'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:04.246136 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] The token cache is being invalidate because project 19df3815256c436dbaad8a146777d7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:34:04.246420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:04.247048 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-60320080-5c7d-4e0d-9abc-e59811baa4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:04.248643 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1440/2879] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:34:04 2022] DELETE /identity/v3/projects/19df3815256c436dbaad8a146777d7aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:13.909048 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:14.240039 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:19.475653 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:19.477098 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:19.490415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28a3a-57b1-46e7-8364-54f1dc3fc4ef admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:19.545879 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:19.547016 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:19.547294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:19.547567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] PATH_INFO: `/v3/users/ada90fd067824007928b5ef9d9cc576e` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:19.548836 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada90fd067824007928b5ef9d9cc576e)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:19.550738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:19.595386 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada90fd067824007928b5ef9d9cc576e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:19.602112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada90fd067824007928b5ef9d9cc576e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:19.602761 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada90fd067824007928b5ef9d9cc576e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:19.603359 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada90fd067824007928b5ef9d9cc576e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:19.615468 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada90fd067824007928b5ef9d9cc576e'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:19.628846 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1440/2880] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:34:19 2022] DELETE /identity/v3/users/ada90fd067824007928b5ef9d9cc576e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:19.633366 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:19.633850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:19.633958 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:19.653337 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:19.654546 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:19.715716 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1441/2881] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:19.726975 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:19.728440 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:19.787408 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d43fb-9d1a-49a4-90d1-605cd2309d49 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:19.791043 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:19.791657 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:19.791958 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:19.792269 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:19.801922 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:19.803351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4196-0e90-4588-ad04-b7020efff653 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:19.812845 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1441/2882] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:20.075514 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.077116 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:20.091902 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62eb16-97ff-48a0-937c-612edd180b54 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.097642 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.098291 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.098575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.098854 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] PATH_INFO: `/v3/projects/91f2c307af954c2ea2feb3bc12cf4e16` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.100073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f2c307af954c2ea2feb3bc12cf4e16)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.102796 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.150334 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f2c307af954c2ea2feb3bc12cf4e16', 'request_id': 'req-db26108f-dc56-4bcf-b57e-7685a5a2b294'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:20.156580 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f2c307af954c2ea2feb3bc12cf4e16', 'request_id': 'req-db26108f-dc56-4bcf-b57e-7685a5a2b294'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:20.164095 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f2c307af954c2ea2feb3bc12cf4e16', 'request_id': 'req-db26108f-dc56-4bcf-b57e-7685a5a2b294'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:20.175125 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] The token cache is being invalidate because project 91f2c307af954c2ea2feb3bc12cf4e16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:34:20.175418 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:20.176086 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-db26108f-dc56-4bcf-b57e-7685a5a2b294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:34:20.177620 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1442/2883] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:34:20 2022] DELETE /identity/v3/projects/91f2c307af954c2ea2feb3bc12cf4e16 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:20.182495 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.182773 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.183056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.202980 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:20.204526 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:20.222333 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:20.267680 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1442/2884] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:20.276957 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.277249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.277534 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.298304 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:20.299516 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:20.307618 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1443/2885] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 31 01:34:20.311501 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.322081 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524b71-6ddc-4488-b230-46cbfbc6b004 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.326697 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.327305 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.327728 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.328061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] PATH_INFO: `/v3/domains` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.328756 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 31 01:34:20.329066 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.331141 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.342924 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1443/2886] 10.222.0.47 () {58 vars in 1153 bytes} [Sun Jul 31 01:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 31 01:34:20.347575 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.357150 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4dd1c-dae0-4163-9a68-67b53d8e2f9b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.362666 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.363272 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.363557 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.363835 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.364536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.366429 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.393562 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1444/2887] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:34:20 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 31 01:34:20.397652 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.408560 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af3844-3066-4613-aac5-de99f9299781 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.466304 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.466918 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.467202 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.467477 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.469142 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.471063 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.492215 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1444/2888] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:34:20 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:34:20.496331 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.506579 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5b55c-da64-4927-9b98-a3629aa9a2c5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.511149 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.511749 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.512063 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.512340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.513025 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.514595 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.524510 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1445/2889] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:34:20.528778 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.539453 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10860f70-cf0a-4d25-8a1a-776a0a9a78da admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.544171 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.544771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.545061 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.545338 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.546030 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.548693 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157fb83-f51e-4ab0-8b0d-c50f56cf1036 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.559223 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1445/2890] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:34:20.563104 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.573045 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af961-add1-4d34-8b72-70cfd6fdade7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.577869 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.578564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.578851 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.579132 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] PATH_INFO: `/v3/projects/8381b612054d45ab8a953c38c1741b55/users/2f0882d1b8184878bd07cc55f0abf7f1/roles/d09d72d9798848e69a01f18d4ae181e4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.594494 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8381b612054d45ab8a953c38c1741b55, user_id=2f0882d1b8184878bd07cc55f0abf7f1, role_id=d09d72d9798848e69a01f18d4ae181e4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.597174 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.611477 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1446/2891] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:34:20 2022] PUT /identity/v3/projects/8381b612054d45ab8a953c38c1741b55/users/2f0882d1b8184878bd07cc55f0abf7f1/roles/d09d72d9798848e69a01f18d4ae181e4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:20.616415 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32048-4264-4ff4-bf52-3ac5560f12f6 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.616711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32048-4264-4ff4-bf52-3ac5560f12f6 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.616991 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32048-4264-4ff4-bf52-3ac5560f12f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.635738 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-37a32048-4264-4ff4-bf52-3ac5560f12f6 None None] MFA Rules not processed for user `4871a0537f4545959c95c90b68cc52fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:20.636998 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-37a32048-4264-4ff4-bf52-3ac5560f12f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:20.695688 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1446/2892] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:20.705907 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:20.707637 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:20.729536 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:20.766551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930548-2630-4668-98fe-798a5271dd33 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:20.770230 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:20.770842 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:20.771129 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:20.771410 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:20.780420 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:20.781884 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:20.791286 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1447/2893] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:24.738947 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:24.739482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:24.739482 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:24.771686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.auth.core [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] MFA Rules not processed for user `2f0882d1b8184878bd07cc55f0abf7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:24.772970 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:24.791329 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:24.850929 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1447/2894] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:24.855646 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:24.869081 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0601f-9730-43df-9cfe-d318d6ff9e97 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:24.874073 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:24.875189 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:24.875564 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:24.875850 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:24.876589 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:24.878553 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:24.909856 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1448/2895] 10.222.0.47 () {60 vars in 1153 bytes} [Sun Jul 31 01:34:24 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:34:24.914384 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:24.932937 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad1584-579d-481a-a2ef-091b5effcf11 None None] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:24.999049 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:24.999714 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] REQUEST_METHOD: `POST` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:25.000033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:25.000317 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] PATH_INFO: `/v3/users` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:25.001033 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:25.003052 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:25.025717 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1448/2896] 10.222.0.47 () {60 vars in 1144 bytes} [Sun Jul 31 01:34:24 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 31 01:34:25.031028 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:25.042954 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b023b1-ad6d-49db-a7b2-baac854c3779 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:25.048455 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:25.049092 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:25.049381 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:25.049664 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:25.050370 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:25.052035 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:25.067390 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1449/2897] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 31 01:34:25.068774 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:25.079409 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10f1c0-4ebf-49b8-9551-5cdc8f8f2cda admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:25.084602 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:25.085366 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:25.085709 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:25.086057 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] PATH_INFO: `/v3/projects/94b864b9f777468596e9af691bec32d1/users/39d4c100d9264274a0c1695443c4d864/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:25.102868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b864b9f777468596e9af691bec32d1, user_id=39d4c100d9264274a0c1695443c4d864, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:25.105595 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:25.120886 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1449/2898] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:34:25 2022] PUT /identity/v3/projects/94b864b9f777468596e9af691bec32d1/users/39d4c100d9264274a0c1695443c4d864/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:25.124787 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:25.135720 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c154c-e2ea-498b-8f03-0f6c0ecc5e3d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:25.198416 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:25.199054 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:25.199338 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:25.199617 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:25.200361 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:25.202002 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b43032-a803-4166-bbae-9e75be4e7b9e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:25.215068 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1450/2899] 10.222.0.47 () {58 vars in 1122 bytes} [Sun Jul 31 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 31 01:34:25.217965 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:25.228575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7b32e-2968-4340-b881-a133354c8e5c admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:25.233422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:25.234655 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:25.234862 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:25.235136 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] PATH_INFO: `/v3/projects/94b864b9f777468596e9af691bec32d1/users/39d4c100d9264274a0c1695443c4d864/roles/c0cc6a3657bb4e54879b1070a008d44d` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:25.237112 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b864b9f777468596e9af691bec32d1, user_id=39d4c100d9264274a0c1695443c4d864, role_id=c0cc6a3657bb4e54879b1070a008d44d)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:25.239751 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:25.251771 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1450/2900] 10.222.0.47 () {60 vars in 1483 bytes} [Sun Jul 31 01:34:25 2022] PUT /identity/v3/projects/94b864b9f777468596e9af691bec32d1/users/39d4c100d9264274a0c1695443c4d864/roles/c0cc6a3657bb4e54879b1070a008d44d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:34:29.836956 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff8d1-4a86-4337-bf03-0ec267e2588c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:29.837864 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff8d1-4a86-4337-bf03-0ec267e2588c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:29.838316 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff8d1-4a86-4337-bf03-0ec267e2588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:29.871638 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c70ff8d1-4a86-4337-bf03-0ec267e2588c None None] MFA Rules not processed for user `39d4c100d9264274a0c1695443c4d864`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:29.872930 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c70ff8d1-4a86-4337-bf03-0ec267e2588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:29.948196 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1451/2901] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:29.962076 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:29.964082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:30.027294 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2c454-83ce-4b87-8b7c-ceda2b321354 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:30.032493 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:30.033125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:30.033403 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:30.033677 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:30.060144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:30.096083 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:30.097537 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:30.107288 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1451/2902] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:30.232947 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211ae42-de6d-4c73-adc8-e5fb4f713d97 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:30.233235 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211ae42-de6d-4c73-adc8-e5fb4f713d97 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:30.234792 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211ae42-de6d-4c73-adc8-e5fb4f713d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:30.253204 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:30.302292 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6211ae42-de6d-4c73-adc8-e5fb4f713d97 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:30.303504 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6211ae42-de6d-4c73-adc8-e5fb4f713d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:30.371208 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1452/2903] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:34:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:30.417819 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:30.419221 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:30.510886 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a1ef-223a-498a-be56-f45eab24f3c6 service glance] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:30.516764 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:30.517379 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:30.517659 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:30.517935 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:30.526719 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:30.528351 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:30.537016 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1452/2904] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:34:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:34:38.929808 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:38.930343 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:38.930456 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:38.949457 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] MFA Rules not processed for user `2f0882d1b8184878bd07cc55f0abf7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:38.950744 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:38.958826 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1453/2905] 10.222.0.47 () {58 vars in 958 bytes} [Sun Jul 31 01:34:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:39.000004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:39.009398 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1a8e-f5fc-4984-9d1e-d42cdc75abc4 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:39.012979 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce143d790f1745f2b66494b85f1fb66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:39.013574 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.013853 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.014125 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.016786 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.090734 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:39.092203 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:39.103315 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1453/2906] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:39.324748 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:39.380133 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae1ee4-988c-4700-a762-5e0fe17a9a75 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:39.383677 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:39.384318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.384607 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.384886 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.386672 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.396769 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:39.398188 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:39.406263 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1454/2907] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:39.713570 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:39.714978 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.731144 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:39.732669 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.736780 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=100 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:39.744722 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc105f7-102c-42dd-bdda-f24057035ca0 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:39.748848 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:39.750109 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.750462 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.750846 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.752852 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.767601 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:39.769075 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4d91f-0a9e-4017-9f61-d5920c854b59 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:39.780785 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1455/2908] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:34:39.788103 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53372a-db07-4f90-9c30-578f12aed081 service glance] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:39.793088 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:39.793711 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:39.794119 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:39.794399 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:39.796848 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:39.808771 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:39.810347 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:39.821962 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1454/2909] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:41.063605 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:41.064127 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:41.064223 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:41.084593 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:34:41.085807 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:41.093748 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1456/2910] 10.222.0.47 () {58 vars in 1009 bytes} [Sun Jul 31 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:34:41.105804 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:41.117573 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b8c0c-98d6-4015-b8cb-3dce9762aafc service placement] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:41.122567 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:41.123179 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:41.123458 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:41.123877 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:41.132572 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:41.134144 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:41.143178 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1455/2911] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:34:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:34:51.079268 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=77 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:51.139015 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=29 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:34:51.640785 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:51.650244 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dbb4b-28b5-4b0c-93a0-44f94593d843 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:51.653900 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:51.654506 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:51.654849 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:51.655124 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:51.656833 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:51.666309 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:51.667715 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:51.676383 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1457/2912] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 31 01:34:52.231126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:52.232621 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:52.248321 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f029-9e54-42e5-bcce-b41265def3a5 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:52.254615 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:52.255311 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:52.255609 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:52.256011 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:52.257949 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:52.276604 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:52.283207 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:52.299100 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1456/2913] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:34:59.823772 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:34:59.839341 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff73acb-c294-4020-9337-8d7d5fe40239 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:34:59.845798 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:34:59.846550 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:34:59.846841 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:34:59.847119 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:34:59.848916 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:34:59.862243 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:34:59.863825 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:34:59.875372 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1458/2914] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:35:02.292541 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:07.287216 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:35:07.297405 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d64d6-6fb3-43d9-bd53-36a16c9f0d92 service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:35:07.301082 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba914491e3643158d83fd51fbfc6263', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:35:07.301688 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:35:07.301971 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:35:07.302247 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:35:07.311309 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:35:07.313434 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:35:07.323212 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1457/2915] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:35:09.870425 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=12 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:35:17.318952 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=6 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:19.345411 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:19.405307 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5b0f-46f7-404d-a3c4-e1746614de32 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:19.410419 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:19.411024 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:19.411308 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:19.411587 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:19.413704 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:19.447706 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:19.449364 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771febf1-aaea-48cf-ad38-68ed5a83689d service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:19.460403 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1459/2916] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:37:29.455051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=36 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:32.087634 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:32.089196 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:32.197435 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3524a-2a37-47a5-9176-356036553b62 service neutron] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:32.205056 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f8bf5d3a0014e24af8195f4cdb1bf66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:32.205968 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:32.206492 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:32.207004 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:32.210299 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:32.230890 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:32.233205 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:32.247667 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1458/2917] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:37:39.532463 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:39.532941 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:39.533051 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:39.553498 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] MFA Rules not processed for user `4f1f366465294ed69b534136c7daf9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 31 01:37:39.554692 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:39.561784 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1460/2918] 10.222.0.47 () {58 vars in 967 bytes} [Sun Jul 31 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 31 01:37:39.603550 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:39.616050 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353743-2ad2-486b-8ddd-bed59b1c9dec service nova] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:39.621126 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d58f02ebba84bf0b29ef054b7d8cc8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:39.621736 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:39.622018 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:39.622293 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:39.630404 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:39.632001 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:39.640003 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1459/2919] 10.222.0.47 () {60 vars in 1384 bytes} [Sun Jul 31 01:37:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 31 01:37:42.805493 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:42.819698 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956114-274f-4e95-85f2-549baf68c4d4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:42.825459 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:42.826145 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:42.826482 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:42.827461 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:42.831372 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:42.844441 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:42.846033 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:42.864079 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1461/2920] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:37:46.258062 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:46.341722 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e62cf-28f3-4988-941b-36cbe7d58f93 service swift] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:46.346400 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:46.347039 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:46.347326 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:46.347605 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] PATH_INFO: `/v3/users/2f0882d1b8184878bd07cc55f0abf7f1` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:46.349324 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0882d1b8184878bd07cc55f0abf7f1)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:46.351234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:46.396472 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0882d1b8184878bd07cc55f0abf7f1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.403251 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0882d1b8184878bd07cc55f0abf7f1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.403914 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0882d1b8184878bd07cc55f0abf7f1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.404554 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0882d1b8184878bd07cc55f0abf7f1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.408909 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:46.418184 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0882d1b8184878bd07cc55f0abf7f1'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.432830 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1460/2921] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:37:46 2022] DELETE /identity/v3/users/2f0882d1b8184878bd07cc55f0abf7f1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:37:46.601551 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:46.612336 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d364da2-a047-45dd-a646-5609a8c140d3 service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:46.671018 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:46.671657 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:46.671961 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:46.672246 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] PATH_INFO: `/v3/projects/8381b612054d45ab8a953c38c1741b55` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:46.673409 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8381b612054d45ab8a953c38c1741b55)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:46.675298 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:46.721094 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8381b612054d45ab8a953c38c1741b55', 'request_id': 'req-0b949298-2b20-4b44-8e3e-bf4e073ba171'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.727130 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8381b612054d45ab8a953c38c1741b55', 'request_id': 'req-0b949298-2b20-4b44-8e3e-bf4e073ba171'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.733982 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8381b612054d45ab8a953c38c1741b55', 'request_id': 'req-0b949298-2b20-4b44-8e3e-bf4e073ba171'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.756959 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] The token cache is being invalidate because project 8381b612054d45ab8a953c38c1741b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:37:46.757249 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.757871 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.759364 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1462/2922] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:37:46 2022] DELETE /identity/v3/projects/8381b612054d45ab8a953c38c1741b55 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:37:46.763410 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:46.764834 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:46.779401 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8a781-3a34-4089-bb8f-c428d1728841 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:46.836584 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:46.837234 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:46.837517 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:46.837791 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] PATH_INFO: `/v3/users/39d4c100d9264274a0c1695443c4d864` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:46.838967 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d4c100d9264274a0c1695443c4d864)` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:46.840910 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:46.886422 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d4c100d9264274a0c1695443c4d864'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.893227 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d4c100d9264274a0c1695443c4d864'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.893883 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d4c100d9264274a0c1695443c4d864'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.894483 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d4c100d9264274a0c1695443c4d864'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.907508 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.notifications [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d4c100d9264274a0c1695443c4d864'} {{(pid=80453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:46.920854 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1461/2923] 10.222.0.47 () {58 vars in 1224 bytes} [Sun Jul 31 01:37:46 2022] DELETE /identity/v3/users/39d4c100d9264274a0c1695443c4d864 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:37:47.092335 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:37:47.093905 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:37:47.108085 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b949298-2b20-4b44-8e3e-bf4e073ba171 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:37:47.170979 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4871a0537f4545959c95c90b68cc52fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764484e0c3894629816e00d4d75ffb98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:37:47.171613 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:37:47.171896 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:37:47.172209 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] PATH_INFO: `/v3/projects/94b864b9f777468596e9af691bec32d1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:37:47.173360 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b864b9f777468596e9af691bec32d1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:37:47.175318 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:37:47.177032 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:47.222745 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b864b9f777468596e9af691bec32d1', 'request_id': 'req-b9ba8afd-ff46-457a-8c1b-6446b9c36372'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:47.228340 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b864b9f777468596e9af691bec32d1', 'request_id': 'req-b9ba8afd-ff46-457a-8c1b-6446b9c36372'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:47.236113 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b864b9f777468596e9af691bec32d1', 'request_id': 'req-b9ba8afd-ff46-457a-8c1b-6446b9c36372'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:47.247303 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] The token cache is being invalidate because project 94b864b9f777468596e9af691bec32d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 31 01:37:47.247594 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:47.248238 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b9ba8afd-ff46-457a-8c1b-6446b9c36372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 31 01:37:47.249744 dv-cinder-master-3-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1463/2924] 10.222.0.47 () {58 vars in 1233 bytes} [Sun Jul 31 01:37:47 2022] DELETE /identity/v3/projects/94b864b9f777468596e9af691bec32d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 31 01:37:56.917135 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:DELETE=13,keystone:SELECT=59,keystone:INSERT=2 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:37:57.244375 dv-cinder-master-3-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 01:42:26.326686 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Authenticating user token {{(pid=80453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 31 01:42:26.328201 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:26.397380 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501702e-ceec-44a7-a3c0-75d4f1b64915 admin admin] Validating token access rules against request {{(pid=80453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 31 01:42:26.457575 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcf777bc227f4dca8be60a22026d1b08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aefae07b6d4844738304e979c85e4764', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 31 01:42:26.458229 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] REQUEST_METHOD: `GET` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 31 01:42:26.458516 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] SCRIPT_NAME: `/identity` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 31 01:42:26.458794 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 31 01:42:26.460868 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.fernet_utils [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 31 01:42:26.472175 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 31 01:42:26.473750 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c0b6a-3eb0-45df-98b0-6c2e6a88cc05 service placement] RBAC: Authorization granted {{(pid=80453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 31 01:42:26.484098 dv-cinder-master-3-smb devstack@keystone.service[80453]: [pid: 80453|app: 0|req: 1462/2925] 10.222.0.47 () {60 vars in 1365 bytes} [Sun Jul 31 01:42:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 31 01:42:36.479699 dv-cinder-master-3-smb devstack@keystone.service[80453]: DEBUG dbcounter [-] [80453] Writing DB stats keystone:SELECT=58 {{(pid=80453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}